-- Logs begin at Tue 2022-08-02 09:56:20 UTC, end at Tue 2022-08-02 11:14:01 UTC. -- Aug 02 10:45:46.841254 dv-cinder-850318-6-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 02 10:45:46.850785 dv-cinder-850318-6-iscsi devstack@n-api.service[115421]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 02 10:45:46.852839 dv-cinder-850318-6-iscsi devstack@n-api.service[115421]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 2 10:45:46 2022] *** Aug 02 10:45:46.852839 dv-cinder-850318-6-iscsi devstack@n-api.service[115421]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 02 10:45:46.852839 dv-cinder-850318-6-iscsi devstack@n-api.service[115421]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 02 10:45:46.852839 dv-cinder-850318-6-iscsi devstack@n-api.service[115421]: nodename: dv-cinder-850318-6-iscsi Aug 02 10:45:46.852839 dv-cinder-850318-6-iscsi devstack@n-api.service[115421]: machine: x86_64 Aug 02 10:45:46.852839 dv-cinder-850318-6-iscsi devstack@n-api.service[115421]: clock source: unix Aug 02 10:45:46.852839 dv-cinder-850318-6-iscsi devstack@n-api.service[115421]: pcre jit disabled Aug 02 10:45:46.852839 dv-cinder-850318-6-iscsi devstack@n-api.service[115421]: detected number of CPU cores: 4 Aug 02 10:45:46.852839 dv-cinder-850318-6-iscsi devstack@n-api.service[115421]: current working directory: / Aug 02 10:45:46.852839 dv-cinder-850318-6-iscsi devstack@n-api.service[115421]: detected binary path: /usr/bin/uwsgi-core Aug 02 10:45:46.852839 dv-cinder-850318-6-iscsi devstack@n-api.service[115421]: your processes number limit is 47680 Aug 02 10:45:46.853654 dv-cinder-850318-6-iscsi devstack@n-api.service[115421]: your memory page size is 4096 bytes Aug 02 10:45:46.853654 dv-cinder-850318-6-iscsi devstack@n-api.service[115421]: detected max file descriptor number: 2048 Aug 02 10:45:46.853654 dv-cinder-850318-6-iscsi devstack@n-api.service[115421]: lock engine: pthread robust mutexes Aug 02 10:45:46.853654 dv-cinder-850318-6-iscsi devstack@n-api.service[115421]: thunder lock: enabled Aug 02 10:45:46.853654 dv-cinder-850318-6-iscsi devstack@n-api.service[115421]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 02 10:45:46.853654 dv-cinder-850318-6-iscsi devstack@n-api.service[115421]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 02 10:45:46.893636 dv-cinder-850318-6-iscsi devstack@n-api.service[115421]: Python main interpreter initialized at 0x556d88de59c0 Aug 02 10:45:46.893636 dv-cinder-850318-6-iscsi devstack@n-api.service[115421]: python threads support enabled Aug 02 10:45:46.893636 dv-cinder-850318-6-iscsi devstack@n-api.service[115421]: your server socket listen backlog is limited to 100 connections Aug 02 10:45:46.893636 dv-cinder-850318-6-iscsi devstack@n-api.service[115421]: your mercy for graceful operations on workers is 90 seconds Aug 02 10:45:46.894053 dv-cinder-850318-6-iscsi devstack@n-api.service[115421]: mapped 403077 bytes (393 KB) for 2 cores Aug 02 10:45:46.894053 dv-cinder-850318-6-iscsi devstack@n-api.service[115421]: *** Operational MODE: preforking *** Aug 02 10:45:46.894323 dv-cinder-850318-6-iscsi devstack@n-api.service[115421]: *** uWSGI is running in multiple interpreter mode *** Aug 02 10:45:46.894323 dv-cinder-850318-6-iscsi devstack@n-api.service[115421]: spawned uWSGI master process (pid: 115421) Aug 02 10:45:46.894540 dv-cinder-850318-6-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 02 10:45:46.895144 dv-cinder-850318-6-iscsi devstack@n-api.service[115421]: spawned uWSGI worker 1 (pid: 115422, cores: 1) Aug 02 10:45:46.895695 dv-cinder-850318-6-iscsi devstack@n-api.service[115421]: spawned uWSGI worker 2 (pid: 115423, cores: 1) Aug 02 10:45:46.895809 dv-cinder-850318-6-iscsi devstack@n-api.service[115421]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 02 10:45:47.569482 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 02 10:45:47.570192 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 02 10:45:48.672454 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 02 10:45:48.672454 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: from cryptography.utils import int_from_bytes Aug 02 10:45:48.673051 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 02 10:45:48.673051 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: from cryptography.utils import int_from_bytes Aug 02 10:45:48.673051 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 02 10:45:48.673051 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: from cryptography.utils import int_from_bytes Aug 02 10:45:48.673564 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 02 10:45:48.673564 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: from cryptography.utils import int_from_bytes Aug 02 10:45:51.195400 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 02 10:45:51.196076 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 02 10:45:51.196470 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 02 10:45:51.196564 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 02 10:45:51.196662 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 02 10:45:51.196747 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 02 10:45:51.196833 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 02 10:45:51.196929 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 02 10:45:51.197029 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 02 10:45:51.197113 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 02 10:45:51.197193 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.197399 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.197504 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.197708 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.197824 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.198042 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.198176 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.198364 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.198547 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.198706 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.198897 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.199021 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.199253 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.199369 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.199579 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.199698 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.199913 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.200029 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.200178 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.200293 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.200500 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.200620 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.200830 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850318-6-iscsi {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.200952 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850318-6-iscsi {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.201158 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.201280 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.201471 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.201576 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.201787 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.201898 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.202111 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.202224 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.202420 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.202531 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.202744 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.202837 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.203067 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.203179 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.203580 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.203687 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.204018 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.204110 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.204329 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.204433 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.204641 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.204732 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.205118 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.205343 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.205343 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.205767 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.205970 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.206194 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.206394 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.206603 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.206830 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.207026 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.207293 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.207554 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.207822 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.208114 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.208114 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850318-6-iscsi {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.208567 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850318-6-iscsi {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.208567 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.208978 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.209177 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.209391 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.209591 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.209808 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.209984 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.210204 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.210392 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.210550 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.210690 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.210858 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.211005 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.211178 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.211327 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.211514 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.211659 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.211804 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.211944 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.212093 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.212257 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.212405 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.212552 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.212699 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.212873 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.213026 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.213174 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.213313 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.213482 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.213635 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.213782 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.213920 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.214078 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.214218 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.214363 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.214508 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.214653 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.214798 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.214944 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.215114 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.215260 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.215397 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.215615 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.215768 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.215908 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.216057 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.216197 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.216340 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.216481 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.216629 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.216771 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.216911 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.217050 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.217197 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.217346 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.217505 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.217652 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.217791 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.217939 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.218085 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.218231 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.218376 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.218514 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.218658 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.218796 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.219014 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.219199 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.219340 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.219489 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.219627 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.219765 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.219925 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.220081 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.220220 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.220367 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.220513 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.220658 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.220810 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.220956 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.221094 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.221232 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.221382 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.221532 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.115 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.221679 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.115 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.221818 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.115 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.221955 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.115 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.222093 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.222230 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.222376 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.222516 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.222654 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.222798 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.222943 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.223234 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.223490 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.223729 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.223882 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.224022 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.224167 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.224307 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.224498 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.224651 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.224801 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.224947 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.225086 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.225232 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.225396 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.225542 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.225691 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.225691 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.225953 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.226099 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.226238 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.226376 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.226513 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.226513 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.226783 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.226783 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.227077 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.227248 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.227389 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.227527 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.227666 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.227817 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.227956 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.228101 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.228239 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.228376 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.228528 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.228676 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.228815 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.228953 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.229101 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.229239 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.229385 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.229532 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.229670 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.229809 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.229964 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.230103 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.230249 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.230402 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.230541 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.230679 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.230828 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.231002 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.231215 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.231358 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.231496 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.231635 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.231783 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.231930 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.232083 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.232230 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.232378 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.232527 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.232667 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.232816 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.232965 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.233111 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.233255 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.233395 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.233532 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.233670 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.233816 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.233816 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.234086 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.234274 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.234415 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.234553 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.234719 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.234867 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.235007 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.235182 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.235324 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.235461 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.235608 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.235749 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.235895 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.236034 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.236186 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.236334 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.236473 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.236629 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.236769 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.236913 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.237059 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.237207 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.237346 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.237491 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.237637 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.237784 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.237922 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.238073 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.238214 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.238353 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.238508 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.239243 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.239342 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.239513 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.239655 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.239801 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.239952 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.240110 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.240110 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.240316 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.240316 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.240463 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.240543 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.240623 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.240717 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.240800 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:45:51.240880 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.240959 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.241037 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.241116 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.241356 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.241448 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.241677 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.241768 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.242017 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.242116 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.242357 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.242455 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.242678 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.242767 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.242995 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.243127 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.243342 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.243440 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.243675 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.243774 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.243987 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.244089 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.244298 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.244386 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.244612 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.244707 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.244931 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.245098 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.245254 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.245365 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.245585 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.245673 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.245903 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.246003 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.246222 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.246317 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.246545 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.246628 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.246863 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.247037 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.247226 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.247365 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.247530 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.247678 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.247913 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.248085 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.248237 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.248388 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.248526 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.248679 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.248829 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.248969 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.249108 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.249246 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.249424 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.249582 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.249736 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.249876 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.250054 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.250211 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.250350 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.250487 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.250666 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.250816 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.250987 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.251178 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.251336 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.251513 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.251670 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.251811 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.251949 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.252086 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.252265 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.252422 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.252562 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.252699 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.252879 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.253033 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.253179 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.253325 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.253490 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.253660 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.253812 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.253951 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.254132 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.254946 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.255179 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.255369 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.255515 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.255664 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.255804 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.255956 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.256130 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.256278 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.256454 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.256603 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.256781 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.256943 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.257105 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.257245 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.257383 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.257521 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.257691 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.257839 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.258010 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.258160 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.258323 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.258478 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.258631 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.258771 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.258967 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.259174 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.259320 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.259459 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.259639 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.259795 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.259935 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.260072 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.260251 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.260406 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.260559 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.260707 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.260847 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.260996 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.261134 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.261287 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.261455 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.261610 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.261748 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.261894 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.262061 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.262217 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.262389 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.262542 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.262682 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.262818 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.262977 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.263166 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.263315 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.263458 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.263629 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.263776 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.263938 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.264098 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.264239 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.264377 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.264555 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.264711 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.264864 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.265013 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.265153 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.265291 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.265470 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.265624 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.265783 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.265927 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.266099 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.266246 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.266418 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.266564 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.266760 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.266923 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.267114 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.267274 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.267414 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.267561 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.267742 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.267890 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.268073 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.268225 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.268392 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.268615 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.268759 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.268897 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.269053 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.269200 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.269339 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.269490 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.269632 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.269771 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.269976 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.270126 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.270335 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.270491 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.270637 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.270775 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.270944 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.271121 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.271267 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.271422 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.271563 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.271703 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.271867 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.272021 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.272192 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.272339 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.272503 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.272657 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.272806 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.272950 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.273107 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.273247 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.273385 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.273524 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.273728 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.273878 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.274027 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.274173 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.274371 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.274517 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.274716 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.274873 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.275024 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.275244 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.275388 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.275526 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.275688 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.275847 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.276012 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.276164 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.276307 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.276444 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.276629 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.276784 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.276925 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.277080 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.277243 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.277390 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.277567 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.277721 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.277887 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.278095 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.278249 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.278387 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.278525 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.278673 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.278812 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.278958 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.279144 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.279297 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.279447 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.279586 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.279753 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.279907 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.280070 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.280217 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.280414 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.280560 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.280748 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.280893 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.281072 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.281231 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.281379 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.281518 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.281696 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.281848 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.282011 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.282156 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.282304 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.282452 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.282622 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.282770 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.282916 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.283113 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.283286 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.283427 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.283566 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.283704 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.283875 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.284031 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.284195 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.284341 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.284507 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.284654 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.284833 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.284992 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.285133 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.285281 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.285494 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.285647 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.285839 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.285999 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.286147 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.286287 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.286486 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.286649 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.286825 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.286982 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.287157 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.287309 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.287450 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.287588 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.287779 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.287935 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.288076 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.288221 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.288395 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.288543 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.288694 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.288833 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.289002 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.289150 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.289311 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.289450 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.289600 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.289740 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.289913 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.290060 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.290224 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.290369 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.290523 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.290671 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.290834 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.290988 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.291196 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.291370 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.291520 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.291661 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.291799 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.291937 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.292075 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.292222 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.292362 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.292507 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.292677 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.292825 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.292991 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.293145 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.293296 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.293435 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.293623 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.293771 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.293918 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.294065 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.294232 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.294333 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.294537 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.294633 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.294845 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.294950 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.295178 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.295278 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.295484 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.295573 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.295791 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.295882 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.296133 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.296221 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.296446 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.296534 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.296755 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.296846 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.297070 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.297157 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.297390 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.297493 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.297705 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.297862 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.298004 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.298141 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.298317 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.298475 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.298616 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.298753 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.298936 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.299122 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.299297 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.299450 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.299597 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.299736 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.299873 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.300027 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.300184 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.300338 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.300492 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.300637 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.300790 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.300935 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.301617 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.301855 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.302179 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.302370 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.302518 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.302664 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.302823 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.302978 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.303151 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.303312 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.303459 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.303605 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.303760 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.303919 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.304105 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.304268 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.304445 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.304599 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.304753 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.304900 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.305074 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.305228 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.305382 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.305536 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.305697 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.305845 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.306030 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.306184 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.306363 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.306530 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.306721 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.306888 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.307092 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.307261 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.307410 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.307556 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.307712 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.307867 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.308022 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.308180 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.308333 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.308480 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.308625 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.308779 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.308934 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.309087 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.309240 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.309650 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.309807 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.309960 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.310120 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.310274 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.310431 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.310585 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.310731 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.310888 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.311041 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.311242 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.311389 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.311533 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.311689 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.311847 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.311994 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.312148 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.312305 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.312458 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.312617 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.312777 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.312923 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.313068 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.313214 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.313366 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.313511 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.313668 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.313815 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.313960 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.314113 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.314270 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.314424 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.314570 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.314716 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.314868 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.315021 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.315194 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.315354 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.315501 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.315647 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.315793 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.315938 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.316092 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.316257 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.316404 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.316549 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.316789 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.317442 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.317600 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.317754 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.317900 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.318046 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.318254 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.318409 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.318565 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.318733 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.318880 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.319027 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.319219 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.319366 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.319529 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.319677 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.319833 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.319981 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.320127 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.320280 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.320440 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.320588 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.320756 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.320902 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.321055 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.321209 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.321356 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.321508 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.321653 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.321809 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.321956 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.322110 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.322257 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.322402 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.322547 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.322703 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.322848 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.323098 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.323256 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.323402 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.323548 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.323693 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.323848 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.324009 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.324158 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.324303 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.324447 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.324600 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.324765 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.324924 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.325071 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.325225 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.325370 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.325523 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.325678 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.325833 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.325978 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.326131 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.326285 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.326431 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.326584 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.326742 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.326897 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.327065 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.327231 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.327380 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.327534 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.327680 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.327825 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.327977 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.328123 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.328284 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.328431 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.328587 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.328732 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.328878 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.329023 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.329181 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.329335 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.329482 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.329626 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.329777 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.329933 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.330087 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.330233 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.330386 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.330543 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.330689 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.330833 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.330987 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.331180 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.331337 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.331485 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.331630 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.331784 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.331941 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.332097 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.332250 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.332498 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.332682 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.332840 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.333029 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.333182 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.333328 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.333474 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.333620 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.333775 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.333921 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.334067 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.334267 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.334420 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.334566 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.334732 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.334885 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.335030 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.335209 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.335366 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.335523 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.335679 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.335832 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.335978 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.336123 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.336268 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.336421 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.336568 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.336724 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.336877 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.337023 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.337175 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.337334 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.337481 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.337626 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.337772 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.337917 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.338062 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.338220 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.338369 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.338525 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.338671 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.338817 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.338961 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.339147 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.339299 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.339445 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.339590 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.339735 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.339899 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.340047 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.340192 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.340337 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.340493 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.340639 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.340804 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.340952 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.341116 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.341263 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.341412 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.341558 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.341712 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.341860 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.342005 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.342149 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.342294 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.342450 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.342604 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.342750 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.342904 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.343122 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.343295 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.343452 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.343599 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.343744 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.343889 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.344034 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.344188 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.344347 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.344509 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.344655 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.344800 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.344951 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.345098 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.345252 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.345399 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.345544 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.345698 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.345844 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.345989 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.346142 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.346300 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.346446 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.346597 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.346742 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.346898 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.347064 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.347220 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.347376 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.347549 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.347698 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.347856 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.348569 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.348722 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.348887 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.349035 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.349188 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.349344 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.349517 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.349716 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.349872 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.350019 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.350171 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.350339 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.350491 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.350637 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.350790 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.350955 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.351186 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.351340 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.351487 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.351639 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.351785 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.351785 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.352147 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.352297 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.352444 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.352589 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.352733 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.352733 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.353033 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.353033 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.353317 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.353461 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.353606 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.353751 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.353904 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.354051 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.354196 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.354340 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.354486 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.354644 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.354801 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.354801 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.355098 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.355098 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.355392 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.355548 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.355704 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.355704 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.356002 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.356002 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.356285 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.356439 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.356585 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.356585 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.356871 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.357016 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.357160 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.357314 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.357460 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.357460 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.357734 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.357904 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.358059 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.358214 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.358361 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.358515 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.358671 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.358816 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.358960 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.359158 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.359326 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.359474 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.359620 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.359765 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.359911 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.360056 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.360210 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.360379 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.360541 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.360695 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.360843 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.360988 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.361141 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.361295 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.361441 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.361586 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.361731 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.361877 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.362098 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.362255 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.362401 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.362557 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.362702 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.362856 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.363010 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.363183 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.363341 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.363488 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.364326 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.364566 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.364767 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.364767 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.365048 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.365194 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.365358 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.365358 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.365659 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.365806 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.365952 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.366098 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.366250 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.366409 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.366563 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.366709 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.366862 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.367014 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.367229 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.367399 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.367545 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.367690 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.367848 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.368004 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.368159 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.368306 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.368452 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.368597 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.368741 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.368887 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.369045 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.369210 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.369357 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.369500 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.369605 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.369694 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.369789 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.369875 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.370006 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.370117 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.370315 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.370428 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.370625 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.370776 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.370936 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.371111 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.371314 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.371443 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.371625 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.371780 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.371951 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.372116 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.372288 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.372435 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.372626 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.372775 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.372942 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.373114 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.373285 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.373435 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.373616 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.373758 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.373935 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.374087 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.374258 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.374400 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.374593 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.374764 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.374913 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.375138 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.375308 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.375457 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.375605 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.375795 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.376000 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.376149 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.376306 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.376454 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.376601 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.376747 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.376901 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.377048 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.377214 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.377362 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.377515 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.377671 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.377819 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.377974 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.378122 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.378267 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.378413 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.378558 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.378704 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.378859 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.379013 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.379247 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.379408 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.379635 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.379882 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.380100 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.380261 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.380408 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.380553 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.380706 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.380853 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.381007 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.381161 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.381308 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.381465 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.381617 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.381772 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.381927 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.382072 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.382217 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.382363 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.382508 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.382670 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.382817 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.382970 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.383162 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.383323 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.383469 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.383632 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.383780 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.383934 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.384083 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.384228 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.384373 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.384528 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.384674 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.384820 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.384967 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.385112 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.385277 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.385424 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.385570 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.385794 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.386201 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.386355 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.386544 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.386776 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.386930 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.387139 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.387296 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.387465 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.387628 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.387796 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.387951 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.388098 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.388245 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.388390 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.388543 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.388690 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.388836 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.389008 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.389163 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.389323 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.389470 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.389633 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.389789 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.389936 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.390082 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.390238 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.390384 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.390563 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.390717 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.390894 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.391088 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.391267 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.391421 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.391579 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.391727 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.391884 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.392112 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.392261 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.392409 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.392559 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.392713 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.392869 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.393026 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.393173 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.393331 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.393478 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.393622 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.393776 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.393935 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.394088 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.394243 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.394405 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.394555 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.394710 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.394920 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.395098 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.395252 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.395419 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.395577 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.395726 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.395872 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.396027 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.396173 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.396318 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.396477 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.396626 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.396779 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.396926 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.397081 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.397245 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.397401 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.397582 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.397764 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.397921 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.398076 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.398232 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.398378 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.398522 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.398733 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.398887 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.399069 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.399382 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.399549 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.399697 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.399843 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.400028 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.400183 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.400342 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.400490 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.400667 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.400825 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.400972 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.401123 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.401279 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.401435 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.401580 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.401727 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.401879 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.402079 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.402239 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.402387 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.402532 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.402686 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.402834 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.402988 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.403209 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.403369 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.403528 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.403674 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.403827 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.403987 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.404135 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.404280 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.404479 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.404632 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.404783 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.404942 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.405178 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.405338 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.405492 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.405657 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.405813 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.405961 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.406137 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.406304 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.406452 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.406598 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.406757 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.406904 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.407076 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.407231 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.407379 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.407525 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.407693 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.407841 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.407986 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.408132 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.408277 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.408422 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.408576 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.408731 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.408878 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.409024 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.409177 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.409332 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.409496 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.409650 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.409797 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.409943 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.410100 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.410268 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.410416 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.411220 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.411390 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.411538 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.411683 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.411841 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.411996 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.412154 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.412302 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.412448 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.412594 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.412748 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.412896 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.413051 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.413205 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.413354 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.413509 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.413662 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.413809 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.413955 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.414111 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.414258 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.414414 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.414561 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.414707 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.414852 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.414998 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.415196 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.415366 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.415516 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.415669 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.415815 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.415815 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.416102 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.416257 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.416405 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.416560 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.416704 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.416849 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.417002 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.417149 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.417302 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.417455 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.417610 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.417756 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.417921 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.418075 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.418221 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.418365 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.418512 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.418657 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.418809 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.418956 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.419123 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.419276 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.419529 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.419691 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.419847 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.420112 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.420267 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.420452 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.420614 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.420770 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.420925 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.421095 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.421247 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.421393 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.421537 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.421765 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.421922 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.422076 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.422235 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.422388 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.422535 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.422694 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.422842 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.422988 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.423197 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.423381 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.423546 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.423702 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.423850 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.423996 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.424152 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.424299 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.424454 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.424601 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.424746 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.424892 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.425039 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.425184 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.425346 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.425510 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.425659 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.425805 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.425968 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.426259 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.426910 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.426910 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.427224 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.427371 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.427517 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.427675 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.427823 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.427970 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.428116 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.428269 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.428415 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.428581 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.428728 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.428874 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.429030 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.429184 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.429331 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.429485 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.429631 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.429776 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.429921 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.430068 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.430222 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.430370 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.430533 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.430681 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.430834 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.430984 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.431219 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.431369 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.431520 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.431665 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.431818 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.431964 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.432119 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.432267 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.432424 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.432570 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.432725 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.432880 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.433027 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.433180 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.433328 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.433475 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.433649 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.433823 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.433971 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.434123 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.434566 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.434726 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.434874 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.435033 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.435209 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.435358 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.435520 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.435672 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.435828 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.435974 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.436149 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.436304 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.436451 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.436607 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.436767 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.436914 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.437059 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.437206 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.437350 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.437497 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.437655 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.437802 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.437954 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.438100 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.438253 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.438419 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.438566 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.438712 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.438865 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.439019 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.439202 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.439360 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.439508 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.439661 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.439807 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.439953 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.440099 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.440253 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.440410 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.440563 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.440710 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.440862 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.441007 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.441169 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.441324 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.441471 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.441617 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.441833 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.441993 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.442141 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.442286 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.442452 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.442608 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.442755 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.442910 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.443117 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.443273 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.443421 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.443577 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.443733 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.443889 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.444036 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.444182 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.444328 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.445308 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.445458 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.445458 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.445458 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.445458 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.445797 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.445882 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.445974 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.446057 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.446177 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.446345 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.446502 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.446670 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.446831 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.446980 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.447156 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.447304 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.447461 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.447615 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.447776 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.447925 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.448071 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.448225 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.448373 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.448527 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.448700 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.448848 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.448996 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.449155 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.449302 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.449461 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.449609 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.449755 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.449900 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.450046 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.450192 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.450346 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.450505 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.450658 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.450812 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.450966 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.451155 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.451394 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.451545 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.451691 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.451845 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.451993 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.452150 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.452307 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.452454 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.452612 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.452759 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.452912 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.453072 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.453222 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.453375 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.453522 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.453667 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.453813 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.453967 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.454115 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.454261 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.454424 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.454578 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.454734 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.454889 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.455036 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.455226 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.455373 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.455529 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.455686 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.455971 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.456128 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.456276 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.457033 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.457204 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.457434 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.457591 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.457738 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.457953 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.458107 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.458264 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.458413 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.458752 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.458902 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.459130 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.459317 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.459475 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.459631 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.459778 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.459924 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.460076 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.460231 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.460381 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.460529 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.460674 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.460820 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.460972 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 02 10:45:51.461129 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.461129 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:45:51.461129 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 02 10:45:51.616806 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: INFO dbcounter [None req-4ad11966-344e-4a72-8918-56c4b41354dc None None] Registered counter for database nova_api Aug 02 10:45:51.617451 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: INFO dbcounter [None req-107862e2-9217-4f0d-a3b7-2833ca3ab14e None None] Registered counter for database nova_api Aug 02 10:45:51.636980 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG oslo_db.sqlalchemy.engines [None req-4ad11966-344e-4a72-8918-56c4b41354dc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115423) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 10:45:51.638546 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG oslo_db.sqlalchemy.engines [None req-107862e2-9217-4f0d-a3b7-2833ca3ab14e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115422) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 10:45:51.643634 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG dbcounter [-] [115423] Writer thread running {{(pid=115423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 10:45:51.645155 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG dbcounter [-] [115422] Writer thread running {{(pid=115422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 10:45:51.700204 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.context [None req-4ad11966-344e-4a72-8918-56c4b41354dc None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8(cell1) {{(pid=115423) load_cells /opt/stack/nova/nova/context.py:464}} Aug 02 10:45:51.701796 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.context [None req-107862e2-9217-4f0d-a3b7-2833ca3ab14e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8(cell1) {{(pid=115422) load_cells /opt/stack/nova/nova/context.py:464}} Aug 02 10:45:51.704184 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG oslo_concurrency.lockutils [None req-4ad11966-344e-4a72-8918-56c4b41354dc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:51.705785 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG oslo_concurrency.lockutils [None req-4ad11966-344e-4a72-8918-56c4b41354dc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:51.705887 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG oslo_concurrency.lockutils [None req-107862e2-9217-4f0d-a3b7-2833ca3ab14e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:51.706588 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG oslo_concurrency.lockutils [None req-4ad11966-344e-4a72-8918-56c4b41354dc None None] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:51.707996 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG oslo_concurrency.lockutils [None req-107862e2-9217-4f0d-a3b7-2833ca3ab14e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:51.708848 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG oslo_concurrency.lockutils [None req-107862e2-9217-4f0d-a3b7-2833ca3ab14e None None] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:45:51.709207 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG oslo_concurrency.lockutils [None req-4ad11966-344e-4a72-8918-56c4b41354dc None None] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:51.710831 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG oslo_concurrency.lockutils [None req-107862e2-9217-4f0d-a3b7-2833ca3ab14e None None] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:45:51.711245 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: INFO dbcounter [None req-4ad11966-344e-4a72-8918-56c4b41354dc None None] Registered counter for database nova_cell0 Aug 02 10:45:51.712859 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: INFO dbcounter [None req-107862e2-9217-4f0d-a3b7-2833ca3ab14e None None] Registered counter for database nova_cell0 Aug 02 10:45:51.716767 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: INFO dbcounter [None req-4ad11966-344e-4a72-8918-56c4b41354dc None None] Registered counter for database nova_cell1 Aug 02 10:45:51.718417 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: INFO dbcounter [None req-107862e2-9217-4f0d-a3b7-2833ca3ab14e None None] Registered counter for database nova_cell1 Aug 02 10:45:51.724993 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG oslo_db.sqlalchemy.engines [None req-4ad11966-344e-4a72-8918-56c4b41354dc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115423) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 10:45:51.727375 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG oslo_db.sqlalchemy.engines [None req-4ad11966-344e-4a72-8918-56c4b41354dc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115423) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 10:45:51.728835 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG oslo_db.sqlalchemy.engines [None req-107862e2-9217-4f0d-a3b7-2833ca3ab14e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115422) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 10:45:51.730836 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG oslo_db.sqlalchemy.engines [None req-107862e2-9217-4f0d-a3b7-2833ca3ab14e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115422) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 10:45:51.732518 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG dbcounter [-] [115423] Writer thread running {{(pid=115423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 10:45:51.736478 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG dbcounter [-] [115422] Writer thread running {{(pid=115422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 10:45:51.741950 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG dbcounter [-] [115422] Writer thread running {{(pid=115422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 10:45:51.869512 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG dbcounter [-] [115423] Writer thread running {{(pid=115423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 10:45:51.879755 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: INFO dbcounter [None req-4ad11966-344e-4a72-8918-56c4b41354dc None None] Registered counter for database nova_cell0 Aug 02 10:45:51.883546 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: INFO dbcounter [None req-107862e2-9217-4f0d-a3b7-2833ca3ab14e None None] Registered counter for database nova_cell0 Aug 02 10:45:51.888867 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG oslo_db.sqlalchemy.engines [None req-4ad11966-344e-4a72-8918-56c4b41354dc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115423) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 10:45:51.892702 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG oslo_db.sqlalchemy.engines [None req-107862e2-9217-4f0d-a3b7-2833ca3ab14e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115422) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 10:45:51.893663 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG dbcounter [-] [115423] Writer thread running {{(pid=115423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 10:45:51.897934 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG dbcounter [-] [115422] Writer thread running {{(pid=115422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 10:45:52.323063 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: WARNING keystonemiddleware.auth_token [None req-4ad11966-344e-4a72-8918-56c4b41354dc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 02 10:45:52.330321 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: WARNING keystonemiddleware.auth_token [None req-4ad11966-344e-4a72-8918-56c4b41354dc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 02 10:45:52.333948 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: WARNING keystonemiddleware.auth_token [None req-107862e2-9217-4f0d-a3b7-2833ca3ab14e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 02 10:45:52.341144 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: WARNING keystonemiddleware.auth_token [None req-107862e2-9217-4f0d-a3b7-2833ca3ab14e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 02 10:45:52.675098 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: WARNING keystonemiddleware.auth_token [None req-4ad11966-344e-4a72-8918-56c4b41354dc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 02 10:45:52.681448 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: WARNING keystonemiddleware.auth_token [None req-4ad11966-344e-4a72-8918-56c4b41354dc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 02 10:45:52.685714 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: WARNING keystonemiddleware.auth_token [None req-107862e2-9217-4f0d-a3b7-2833ca3ab14e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 02 10:45:52.687012 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556d88de59c0 pid: 115423 (default app) Aug 02 10:45:52.689152 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi [None req-4ad11966-344e-4a72-8918-56c4b41354dc None None] Calling method '>' {{(pid=115423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:45:52.690352 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: INFO nova.api.openstack.requestlog [None req-4ad11966-344e-4a72-8918-56c4b41354dc None None] 10.222.0.115 "GET /compute/v2.1/" status: 200 len: 389 microversion: 2.1 time: 0.001785 Aug 02 10:45:52.690763 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: [pid: 115423|app: 0|req: 1/1] 10.222.0.115 () {50 vars in 793 bytes} [Tue Aug 2 10:45:52 2022] GET /compute/v2.1/ => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:45:52.691741 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: WARNING keystonemiddleware.auth_token [None req-107862e2-9217-4f0d-a3b7-2833ca3ab14e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 02 10:45:52.697256 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556d88de59c0 pid: 115422 (default app) Aug 02 10:47:12.151851 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi [None req-4ad11966-344e-4a72-8918-56c4b41354dc None None] Calling method '>' {{(pid=115423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:47:12.152884 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: INFO nova.api.openstack.requestlog [None req-4ad11966-344e-4a72-8918-56c4b41354dc None None] 10.222.0.115 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001500 Aug 02 10:47:12.153558 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: [pid: 115423|app: 0|req: 2/2] 10.222.0.115 () {54 vars in 935 bytes} [Tue Aug 2 10:47:12 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:47:12.169867 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG dbcounter [-] [115422] Writing DB stats nova_api:SELECT=3 {{(pid=115422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:47:12.171024 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG dbcounter [-] [115422] Writing DB stats nova_cell1:SELECT=3 {{(pid=115422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:47:12.172280 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG dbcounter [-] [115422] Writing DB stats nova_cell0:SELECT=3 {{(pid=115422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:47:12.173356 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG dbcounter [-] [115422] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=115422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:47:13.065632 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi [None req-44e261b9-818d-49d5-ab08-2f0ef013f9cc admin admin] Calling method '>' {{(pid=115422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:47:13.101103 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: INFO nova.api.openstack.requestlog [None req-44e261b9-818d-49d5-ab08-2f0ef013f9cc admin admin] 10.222.0.115 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.940252 Aug 02 10:47:13.123076 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: [pid: 115422|app: 0|req: 1/3] 10.222.0.115 () {60 vars in 1296 bytes} [Tue Aug 2 10:47:12 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:47:15.330396 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi [None req-4ad11966-344e-4a72-8918-56c4b41354dc None None] Calling method '>' {{(pid=115423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:47:15.331667 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: INFO nova.api.openstack.requestlog [None req-4ad11966-344e-4a72-8918-56c4b41354dc None None] 10.222.0.115 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001594 Aug 02 10:47:15.332322 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: [pid: 115423|app: 0|req: 3/4] 10.222.0.115 () {54 vars in 935 bytes} [Tue Aug 2 10:47:15 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:47:15.834037 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi [None req-d7c3660d-c157-44f8-83a6-0195505b2717 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "ram": 256, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "cirros256"}} {{(pid=115422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:47:15.854253 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 10:47:15.854253 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: warnings.warn(msg) Aug 02 10:47:15.938197 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: INFO nova.api.openstack.requestlog [None req-d7c3660d-c157-44f8-83a6-0195505b2717 admin admin] 10.222.0.115 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.61 time: 0.599551 Aug 02 10:47:15.938957 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: [pid: 115422|app: 0|req: 2/5] 10.222.0.115 () {64 vars in 1287 bytes} [Tue Aug 2 10:47:15 2022] POST /compute/v2.1/flavors => generated 409 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 10:47:16.165918 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi [None req-0b922b10-c39d-4421-92eb-ed84cec651a3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:47:16.170111 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 10:47:16.170111 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: warnings.warn(msg) Aug 02 10:47:16.172898 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG dbcounter [-] [115423] Writing DB stats nova_api:SELECT=3 {{(pid=115423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:47:16.173765 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG dbcounter [-] [115423] Writing DB stats nova_cell0:SELECT=3 {{(pid=115423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:47:16.174699 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG dbcounter [-] [115423] Writing DB stats nova_cell1:SELECT=3 {{(pid=115423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:47:16.175491 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG dbcounter [-] [115423] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=115423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:47:16.295472 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: INFO nova.api.openstack.requestlog [None req-0b922b10-c39d-4421-92eb-ed84cec651a3 admin admin] 10.222.0.115 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.347109 Aug 02 10:47:16.296332 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: [pid: 115423|app: 0|req: 4/6] 10.222.0.115 () {64 vars in 1340 bytes} [Tue Aug 2 10:47:15 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:47:18.542309 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi [None req-d7c3660d-c157-44f8-83a6-0195505b2717 admin admin] Calling method '>' {{(pid=115422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:47:18.543495 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: INFO nova.api.openstack.requestlog [None req-d7c3660d-c157-44f8-83a6-0195505b2717 admin admin] 10.222.0.115 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.002263 Aug 02 10:47:18.546187 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: [pid: 115422|app: 0|req: 3/7] 10.222.0.115 () {54 vars in 935 bytes} [Tue Aug 2 10:47:18 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:47:19.223434 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi [None req-6b3c09b7-c711-4c70-8870-d507cda0b207 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "os-flavor-access:is_public": true, "ram": 512, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "rxtx_factor": 1.0, "name": "ds512M", "id": "d1"}} {{(pid=115423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:47:19.254395 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 10:47:19.254395 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: warnings.warn(msg) Aug 02 10:47:19.377303 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: INFO nova.api.openstack.requestlog [None req-6b3c09b7-c711-4c70-8870-d507cda0b207 admin admin] 10.222.0.115 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.826256 Aug 02 10:47:19.377979 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: [pid: 115423|app: 0|req: 5/8] 10.222.0.115 () {64 vars in 1287 bytes} [Tue Aug 2 10:47:18 2022] POST /compute/v2.1/flavors => generated 406 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:47:19.389981 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi [None req-24bc1733-fb78-4e08-8ecf-32957edf244d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:47:19.393470 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 10:47:19.393470 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: warnings.warn(msg) Aug 02 10:47:19.473310 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: INFO nova.api.openstack.requestlog [None req-24bc1733-fb78-4e08-8ecf-32957edf244d admin admin] 10.222.0.115 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.086757 Aug 02 10:47:19.474160 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: [pid: 115422|app: 0|req: 4/9] 10.222.0.115 () {64 vars in 1340 bytes} [Tue Aug 2 10:47:19 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:47:21.751678 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi [None req-6b3c09b7-c711-4c70-8870-d507cda0b207 admin admin] Calling method '>' {{(pid=115423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:47:21.752697 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: INFO nova.api.openstack.requestlog [None req-6b3c09b7-c711-4c70-8870-d507cda0b207 admin admin] 10.222.0.115 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001492 Aug 02 10:47:21.753125 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: [pid: 115423|app: 0|req: 6/10] 10.222.0.115 () {54 vars in 935 bytes} [Tue Aug 2 10:47:21 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:47:22.155213 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi [None req-8d7a43d7-8ecb-464f-8783-8699b70a5272 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "ram": 1024, "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "name": "ds1G", "id": "d2"}} {{(pid=115422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:47:22.227189 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: INFO nova.api.openstack.requestlog [None req-8d7a43d7-8ecb-464f-8783-8699b70a5272 admin admin] 10.222.0.115 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.468075 Aug 02 10:47:22.227936 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: [pid: 115422|app: 0|req: 5/11] 10.222.0.115 () {64 vars in 1287 bytes} [Tue Aug 2 10:47:21 2022] POST /compute/v2.1/flavors => generated 406 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:47:22.240758 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi [None req-698b67f4-5a7b-4fa8-9442-b26ab06c3807 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:47:22.339042 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: INFO nova.api.openstack.requestlog [None req-698b67f4-5a7b-4fa8-9442-b26ab06c3807 admin admin] 10.222.0.115 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.102275 Aug 02 10:47:22.339801 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: [pid: 115423|app: 0|req: 7/12] 10.222.0.115 () {64 vars in 1340 bytes} [Tue Aug 2 10:47:22 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:47:24.548833 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi [None req-8d7a43d7-8ecb-464f-8783-8699b70a5272 admin admin] Calling method '>' {{(pid=115422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:47:24.549849 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: INFO nova.api.openstack.requestlog [None req-8d7a43d7-8ecb-464f-8783-8699b70a5272 admin admin] 10.222.0.115 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001460 Aug 02 10:47:24.550247 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: [pid: 115422|app: 0|req: 6/13] 10.222.0.115 () {54 vars in 935 bytes} [Tue Aug 2 10:47:24 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:47:25.024357 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi [None req-51d9893c-4578-4c8d-a841-01f3eb389138 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "name": "ds2G", "disk": 10, "ram": 2048, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "d3"}} {{(pid=115423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:47:25.113217 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: INFO nova.api.openstack.requestlog [None req-51d9893c-4578-4c8d-a841-01f3eb389138 admin admin] 10.222.0.115 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.557051 Aug 02 10:47:25.114113 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: [pid: 115423|app: 0|req: 8/14] 10.222.0.115 () {64 vars in 1287 bytes} [Tue Aug 2 10:47:24 2022] POST /compute/v2.1/flavors => generated 406 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:47:25.127594 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi [None req-d4eff888-7259-48fd-a676-dfd11e3e8e7f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:47:25.208004 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: INFO nova.api.openstack.requestlog [None req-d4eff888-7259-48fd-a676-dfd11e3e8e7f admin admin] 10.222.0.115 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.085393 Aug 02 10:47:25.208549 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: [pid: 115422|app: 0|req: 7/15] 10.222.0.115 () {64 vars in 1340 bytes} [Tue Aug 2 10:47:25 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:47:27.451515 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi [None req-51d9893c-4578-4c8d-a841-01f3eb389138 admin admin] Calling method '>' {{(pid=115423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:47:27.453396 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: INFO nova.api.openstack.requestlog [None req-51d9893c-4578-4c8d-a841-01f3eb389138 admin admin] 10.222.0.115 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.002327 Aug 02 10:47:27.453980 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: [pid: 115423|app: 0|req: 9/16] 10.222.0.115 () {54 vars in 935 bytes} [Tue Aug 2 10:47:27 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:47:27.894706 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi [None req-0113dbe2-8861-4da4-a333-62e9abea8f68 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "os-flavor-access:is_public": true, "ram": 4096, "rxtx_factor": 1.0, "vcpus": 4, "swap": 0, "id": "d4", "name": "ds4G"}} {{(pid=115422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:47:27.964510 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: INFO nova.api.openstack.requestlog [None req-0113dbe2-8861-4da4-a333-62e9abea8f68 admin admin] 10.222.0.115 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.502908 Aug 02 10:47:27.972254 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: [pid: 115422|app: 0|req: 8/17] 10.222.0.115 () {64 vars in 1287 bytes} [Tue Aug 2 10:47:27 2022] POST /compute/v2.1/flavors => generated 406 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:47:27.977339 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi [None req-130a6407-56aa-46e7-a649-7e82f6caa59f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:47:28.076416 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: INFO nova.api.openstack.requestlog [None req-130a6407-56aa-46e7-a649-7e82f6caa59f admin admin] 10.222.0.115 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.102856 Aug 02 10:47:28.077179 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: [pid: 115423|app: 0|req: 10/18] 10.222.0.115 () {64 vars in 1340 bytes} [Tue Aug 2 10:47:27 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:47:30.307144 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi [None req-0113dbe2-8861-4da4-a333-62e9abea8f68 admin admin] Calling method '>' {{(pid=115422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:47:30.308167 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: INFO nova.api.openstack.requestlog [None req-0113dbe2-8861-4da4-a333-62e9abea8f68 admin admin] 10.222.0.115 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001586 Aug 02 10:47:30.308576 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: [pid: 115422|app: 0|req: 9/19] 10.222.0.115 () {54 vars in 935 bytes} [Tue Aug 2 10:47:30 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:47:30.756367 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi [None req-12b97954-91ff-4c05-bcbc-bdb33dcffa19 admin admin] Calling method '>' {{(pid=115423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:47:30.783745 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: INFO nova.api.openstack.requestlog [None req-12b97954-91ff-4c05-bcbc-bdb33dcffa19 admin admin] 10.222.0.115 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2116 microversion: 2.61 time: 0.468408 Aug 02 10:47:30.784304 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: [pid: 115423|app: 0|req: 11/20] 10.222.0.115 () {60 vars in 1296 bytes} [Tue Aug 2 10:47:30 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2116 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:47:32.999365 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi [None req-0113dbe2-8861-4da4-a333-62e9abea8f68 admin admin] Calling method '>' {{(pid=115422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:47:33.000488 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: INFO nova.api.openstack.requestlog [None req-0113dbe2-8861-4da4-a333-62e9abea8f68 admin admin] 10.222.0.115 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001655 Aug 02 10:47:33.000926 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: [pid: 115422|app: 0|req: 10/21] 10.222.0.115 () {54 vars in 935 bytes} [Tue Aug 2 10:47:32 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:47:33.428167 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi [None req-03db134c-0820-4a4f-a879-a2b9d0301625 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 1, "name": "m1.tiny", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "1", "vcpus": 1}} {{(pid=115423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:47:33.506972 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: INFO nova.api.openstack.requestlog [None req-03db134c-0820-4a4f-a879-a2b9d0301625 admin admin] 10.222.0.115 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.500098 Aug 02 10:47:33.507565 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: [pid: 115423|app: 0|req: 12/22] 10.222.0.115 () {64 vars in 1287 bytes} [Tue Aug 2 10:47:33 2022] POST /compute/v2.1/flavors => generated 404 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:47:33.521444 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi [None req-2c6b9658-9870-4e2b-9b59-5dd53cf14f34 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:47:33.616600 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: INFO nova.api.openstack.requestlog [None req-2c6b9658-9870-4e2b-9b59-5dd53cf14f34 admin admin] 10.222.0.115 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.100181 Aug 02 10:47:33.617491 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: [pid: 115422|app: 0|req: 11/23] 10.222.0.115 () {64 vars in 1337 bytes} [Tue Aug 2 10:47:33 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:47:35.872661 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi [None req-03db134c-0820-4a4f-a879-a2b9d0301625 admin admin] Calling method '>' {{(pid=115423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:47:35.874195 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: INFO nova.api.openstack.requestlog [None req-03db134c-0820-4a4f-a879-a2b9d0301625 admin admin] 10.222.0.115 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001458 Aug 02 10:47:35.874780 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: [pid: 115423|app: 0|req: 13/24] 10.222.0.115 () {54 vars in 935 bytes} [Tue Aug 2 10:47:35 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:47:36.404149 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi [None req-0afb53af-65ca-4067-b742-8907d1af9064 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "rxtx_factor": 1.0, "name": "m1.small", "disk": 20, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 1, "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=115422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:47:36.484212 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: INFO nova.api.openstack.requestlog [None req-0afb53af-65ca-4067-b742-8907d1af9064 admin admin] 10.222.0.115 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.602556 Aug 02 10:47:36.484978 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: [pid: 115422|app: 0|req: 12/25] 10.222.0.115 () {64 vars in 1287 bytes} [Tue Aug 2 10:47:35 2022] POST /compute/v2.1/flavors => generated 407 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:47:36.496686 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi [None req-11642e3b-96ec-40d1-ac13-f5bef59ced91 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:47:36.579226 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: INFO nova.api.openstack.requestlog [None req-11642e3b-96ec-40d1-ac13-f5bef59ced91 admin admin] 10.222.0.115 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.086305 Aug 02 10:47:36.579802 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: [pid: 115423|app: 0|req: 14/26] 10.222.0.115 () {64 vars in 1337 bytes} [Tue Aug 2 10:47:36 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:47:38.838310 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi [None req-0afb53af-65ca-4067-b742-8907d1af9064 admin admin] Calling method '>' {{(pid=115422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:47:38.838310 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: INFO nova.api.openstack.requestlog [None req-0afb53af-65ca-4067-b742-8907d1af9064 admin admin] 10.222.0.115 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001476 Aug 02 10:47:38.838985 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: [pid: 115422|app: 0|req: 13/27] 10.222.0.115 () {54 vars in 935 bytes} [Tue Aug 2 10:47:38 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:47:39.258582 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi [None req-89f575cc-1baa-4314-a0ad-74846b2f6f61 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40, "vcpus": 2, "rxtx_factor": 1.0, "name": "m1.medium", "id": "3"}} {{(pid=115423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:47:39.364394 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: INFO nova.api.openstack.requestlog [None req-89f575cc-1baa-4314-a0ad-74846b2f6f61 admin admin] 10.222.0.115 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.517499 Aug 02 10:47:39.364956 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: [pid: 115423|app: 0|req: 15/28] 10.222.0.115 () {64 vars in 1287 bytes} [Tue Aug 2 10:47:38 2022] POST /compute/v2.1/flavors => generated 408 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:47:39.377704 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi [None req-465b8d7b-e21f-4a2b-aaf5-91a512de60be admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:47:39.468414 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: INFO nova.api.openstack.requestlog [None req-465b8d7b-e21f-4a2b-aaf5-91a512de60be admin admin] 10.222.0.115 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.095220 Aug 02 10:47:39.469001 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: [pid: 115422|app: 0|req: 14/29] 10.222.0.115 () {64 vars in 1337 bytes} [Tue Aug 2 10:47:39 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:47:41.916336 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi [None req-89f575cc-1baa-4314-a0ad-74846b2f6f61 admin admin] Calling method '>' {{(pid=115423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:47:41.917353 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: INFO nova.api.openstack.requestlog [None req-89f575cc-1baa-4314-a0ad-74846b2f6f61 admin admin] 10.222.0.115 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001452 Aug 02 10:47:41.917758 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: [pid: 115423|app: 0|req: 16/30] 10.222.0.115 () {54 vars in 935 bytes} [Tue Aug 2 10:47:41 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:47:42.391573 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi [None req-2ee7f18d-ee32-488b-925e-a50427a271f0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large", "id": "4", "swap": 0, "disk": 80, "ram": 8192, "os-flavor-access:is_public": true, "vcpus": 4}} {{(pid=115422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:47:42.397390 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG dbcounter [-] [115422] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=115422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:47:42.515683 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: INFO nova.api.openstack.requestlog [None req-2ee7f18d-ee32-488b-925e-a50427a271f0 admin admin] 10.222.0.115 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.591494 Aug 02 10:47:42.523829 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: [pid: 115422|app: 0|req: 15/31] 10.222.0.115 () {64 vars in 1287 bytes} [Tue Aug 2 10:47:41 2022] POST /compute/v2.1/flavors => generated 407 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 10:47:42.528943 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi [None req-53edbdfb-7b74-49e2-a2e5-0396f67a9147 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:47:42.625597 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: INFO nova.api.openstack.requestlog [None req-53edbdfb-7b74-49e2-a2e5-0396f67a9147 admin admin] 10.222.0.115 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.100409 Aug 02 10:47:42.626271 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: [pid: 115423|app: 0|req: 17/32] 10.222.0.115 () {64 vars in 1337 bytes} [Tue Aug 2 10:47:42 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:47:44.932117 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi [None req-2ee7f18d-ee32-488b-925e-a50427a271f0 admin admin] Calling method '>' {{(pid=115422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:47:44.933130 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: INFO nova.api.openstack.requestlog [None req-2ee7f18d-ee32-488b-925e-a50427a271f0 admin admin] 10.222.0.115 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001471 Aug 02 10:47:44.933711 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: [pid: 115422|app: 0|req: 16/33] 10.222.0.115 () {54 vars in 935 bytes} [Tue Aug 2 10:47:44 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:47:45.489698 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi [None req-db55cfd0-896b-4295-9197-9e3cf43c9a36 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "5", "ram": 16384, "os-flavor-access:is_public": true, "disk": 160, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge", "vcpus": 8}} {{(pid=115423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:47:46.266602 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: INFO nova.api.openstack.requestlog [None req-db55cfd0-896b-4295-9197-9e3cf43c9a36 admin admin] 10.222.0.115 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.61 time: 1.325604 Aug 02 10:47:46.275304 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: [pid: 115423|app: 0|req: 18/34] 10.222.0.115 () {64 vars in 1287 bytes} [Tue Aug 2 10:47:44 2022] POST /compute/v2.1/flavors => generated 410 bytes in 1328 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:47:46.282325 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi [None req-74cb9712-7a88-4119-906a-f81b2ad3da89 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:47:46.372982 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: INFO nova.api.openstack.requestlog [None req-74cb9712-7a88-4119-906a-f81b2ad3da89 admin admin] 10.222.0.115 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.096121 Aug 02 10:47:46.374127 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: [pid: 115422|app: 0|req: 17/35] 10.222.0.115 () {64 vars in 1337 bytes} [Tue Aug 2 10:47:46 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:48:06.121709 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi [None req-db55cfd0-896b-4295-9197-9e3cf43c9a36 admin admin] Calling method '>' {{(pid=115423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:48:06.122761 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: INFO nova.api.openstack.requestlog [None req-db55cfd0-896b-4295-9197-9e3cf43c9a36 admin admin] 10.222.0.115 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001473 Aug 02 10:48:06.123212 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: [pid: 115423|app: 0|req: 19/36] 10.222.0.115 () {54 vars in 935 bytes} [Tue Aug 2 10:48:06 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:48:06.533473 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi [None req-bc6d5015-8852-469c-bf9c-97f6025dba23 admin admin] Calling method '>' {{(pid=115422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:48:06.552405 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: INFO nova.api.openstack.requestlog [None req-bc6d5015-8852-469c-bf9c-97f6025dba23 admin admin] 10.222.0.115 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4222 microversion: 2.61 time: 0.423174 Aug 02 10:48:06.552876 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: [pid: 115422|app: 0|req: 18/37] 10.222.0.115 () {60 vars in 1296 bytes} [Tue Aug 2 10:48:06 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4222 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:48:07.630844 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi [None req-db55cfd0-896b-4295-9197-9e3cf43c9a36 admin admin] Calling method '>' {{(pid=115423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:48:07.631969 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: INFO nova.api.openstack.requestlog [None req-db55cfd0-896b-4295-9197-9e3cf43c9a36 admin admin] 10.222.0.115 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001555 Aug 02 10:48:07.632371 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: [pid: 115423|app: 0|req: 20/38] 10.222.0.115 () {56 vars in 1079 bytes} [Tue Aug 2 10:48:07 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:48:08.201611 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi [None req-1b0d0510-32e5-4367-a4eb-47cf658df575 admin admin] Calling method '>' {{(pid=115422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:48:08.207503 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: INFO nova.api.openstack.wsgi [None req-1b0d0510-32e5-4367-a4eb-47cf658df575 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 02 10:48:08.210790 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi [None req-1b0d0510-32e5-4367-a4eb-47cf658df575 admin admin] Request method failure captured: Aug 02 10:48:08.210790 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 02 10:48:08.210790 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: Accept: application/json Aug 02 10:48:08.210790 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: Accept-Encoding: gzip, deflate Aug 02 10:48:08.210790 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: Connection: keep-alive Aug 02 10:48:08.210790 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: Content-Length: 0 Aug 02 10:48:08.210790 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: Host: 10.222.0.115 Aug 02 10:48:08.210790 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: Openstack-Api-Version: compute 2.90 Aug 02 10:48:08.210790 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: Openstack-System-Scope: None Aug 02 10:48:08.210790 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: User-Agent: python-novaclient Aug 02 10:48:08.210790 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: X-Auth-Token: gAAAAABi6QDnKM6NTzV10h203MwSXiqJUpaTdEmMIyPEaJPiPp4GFbCy72vLZyLSPszt7aun3mWU4PWzQXkyIs2knNX6kKKHGhauSE5U8qnowAXR84Z6KPKirhrTg9YkJS5T1inw-TKMI1PoGuzgVpwoQFXGHEWcPo6LlDyzVecDLxpNTw_sHEY Aug 02 10:48:08.210790 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: X-Domain-Id: None Aug 02 10:48:08.210790 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: X-Domain-Name: None Aug 02 10:48:08.210790 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: X-Identity-Status: Confirmed Aug 02 10:48:08.210790 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: X-Is-Admin-Project: True Aug 02 10:48:08.210790 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: X-Openstack-Nova-Api-Version: 2.90 Aug 02 10:48:08.210790 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: X-Project-Domain-Id: default Aug 02 10:48:08.210790 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: X-Project-Domain-Name: Default Aug 02 10:48:08.210790 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: X-Project-Id: b86f954a6cac457bad0b226e93315c59 Aug 02 10:48:08.210790 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: X-Project-Name: admin Aug 02 10:48:08.210790 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: X-Role: admin,reader,member Aug 02 10:48:08.210790 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: X-Roles: admin,reader,member Aug 02 10:48:08.212647 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/b86f954a6cac457bad0b226e93315c59"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2/b86f954a6cac457bad0b226e93315c59"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/b86f954a6cac457bad0b226e93315c59"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.115:8080", "publicURL": "http://10.222.0.115:8080/v1/AUTH_b86f954a6cac457bad0b226e93315c59"}]}] Aug 02 10:48:08.212647 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: X-Tenant: admin Aug 02 10:48:08.212647 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: X-Tenant-Id: b86f954a6cac457bad0b226e93315c59 Aug 02 10:48:08.212647 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: X-Tenant-Name: admin Aug 02 10:48:08.212647 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: X-User: admin Aug 02 10:48:08.212647 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: X-User-Domain-Id: default Aug 02 10:48:08.212647 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: X-User-Domain-Name: Default Aug 02 10:48:08.212647 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: X-User-Id: 4fb0c392df554f5dbd68f6861be954a1 Aug 02 10:48:08.212647 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: X-User-Name: admin Aug 02 10:48:08.212647 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: method: > Aug 02 10:48:08.212647 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: exception: Flavor 42 could not be found. Aug 02 10:48:08.212647 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: action_args: {'id': '42'} Aug 02 10:48:08.212647 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: {{(pid=115422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:48:08.212647 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:48:08.213505 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 02 10:48:08.213505 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 02 10:48:08.213505 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 02 10:48:08.213505 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 02 10:48:08.213505 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 02 10:48:08.213505 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 02 10:48:08.213505 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 02 10:48:08.213505 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 02 10:48:08.213505 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 02 10:48:08.213505 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:48:08.213505 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 02 10:48:08.213505 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 02 10:48:08.213505 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 02 10:48:08.213505 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: ERROR nova.api.openstack.wsgi Aug 02 10:48:08.213505 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:48:08.213505 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: ERROR nova.api.openstack.wsgi Aug 02 10:48:08.213505 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:48:08.213505 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:48:08.213505 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:48:08.214671 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:48:08.214671 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:48:08.214671 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:48:08.214671 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:48:08.214671 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 02 10:48:08.214671 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 02 10:48:08.214671 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 02 10:48:08.214671 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: ERROR nova.api.openstack.wsgi Aug 02 10:48:08.214671 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:48:08.214671 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: ERROR nova.api.openstack.wsgi Aug 02 10:48:08.214671 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:48:08.214671 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:48:08.214671 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:48:08.214671 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:48:08.214671 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:48:08.214671 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 02 10:48:08.214671 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: ERROR nova.api.openstack.wsgi Aug 02 10:48:08.214671 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi [None req-1b0d0510-32e5-4367-a4eb-47cf658df575 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=115422) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:48:08.216866 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: INFO nova.api.openstack.requestlog [None req-1b0d0510-32e5-4367-a4eb-47cf658df575 admin admin] 10.222.0.115 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.440574 Aug 02 10:48:08.216866 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: [pid: 115422|app: 0|req: 19/39] 10.222.0.115 () {60 vars in 1195 bytes} [Tue Aug 2 10:48:07 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 442 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 02 10:48:08.222259 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi [None req-3b0212b7-23f6-459f-b6fe-38607202bdc1 admin admin] Calling method '>' {{(pid=115423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:48:08.226506 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG dbcounter [-] [115423] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=115423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:48:08.245822 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: INFO nova.api.openstack.requestlog [None req-3b0212b7-23f6-459f-b6fe-38607202bdc1 admin admin] 10.222.0.115 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.027212 Aug 02 10:48:08.246389 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: [pid: 115423|app: 0|req: 21/40] 10.222.0.115 () {60 vars in 1215 bytes} [Tue Aug 2 10:48:08 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:48:08.256932 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi [None req-f01a6a58-cf74-443d-97da-543af5610b85 admin admin] Calling method '>' {{(pid=115422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:48:08.281230 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: INFO nova.api.openstack.requestlog [None req-f01a6a58-cf74-443d-97da-543af5610b85 admin admin] 10.222.0.115 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.027853 Aug 02 10:48:08.281796 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: [pid: 115422|app: 0|req: 20/41] 10.222.0.115 () {60 vars in 1215 bytes} [Tue Aug 2 10:48:08 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:48:08.291379 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi [None req-c1df50b4-67d4-4217-911f-11683aab5aa1 admin admin] Calling method '>' {{(pid=115423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:48:08.298070 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: INFO nova.api.openstack.wsgi [None req-c1df50b4-67d4-4217-911f-11683aab5aa1 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 02 10:48:08.301366 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi [None req-c1df50b4-67d4-4217-911f-11683aab5aa1 admin admin] Request method failure captured: Aug 02 10:48:08.301366 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 02 10:48:08.301366 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: Accept: application/json Aug 02 10:48:08.301366 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: Accept-Encoding: gzip, deflate Aug 02 10:48:08.301366 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: Connection: keep-alive Aug 02 10:48:08.301366 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: Content-Length: 0 Aug 02 10:48:08.301366 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: Host: 10.222.0.115 Aug 02 10:48:08.301366 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: Openstack-Api-Version: compute 2.90 Aug 02 10:48:08.301366 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: Openstack-System-Scope: None Aug 02 10:48:08.301366 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: User-Agent: python-novaclient Aug 02 10:48:08.301366 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: X-Auth-Token: gAAAAABi6QDnKM6NTzV10h203MwSXiqJUpaTdEmMIyPEaJPiPp4GFbCy72vLZyLSPszt7aun3mWU4PWzQXkyIs2knNX6kKKHGhauSE5U8qnowAXR84Z6KPKirhrTg9YkJS5T1inw-TKMI1PoGuzgVpwoQFXGHEWcPo6LlDyzVecDLxpNTw_sHEY Aug 02 10:48:08.301366 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: X-Domain-Id: None Aug 02 10:48:08.301366 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: X-Domain-Name: None Aug 02 10:48:08.301366 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: X-Identity-Status: Confirmed Aug 02 10:48:08.301366 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: X-Is-Admin-Project: True Aug 02 10:48:08.301366 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: X-Openstack-Nova-Api-Version: 2.90 Aug 02 10:48:08.301366 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: X-Project-Domain-Id: default Aug 02 10:48:08.301366 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: X-Project-Domain-Name: Default Aug 02 10:48:08.301366 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: X-Project-Id: b86f954a6cac457bad0b226e93315c59 Aug 02 10:48:08.301366 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: X-Project-Name: admin Aug 02 10:48:08.301366 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: X-Role: admin,reader,member Aug 02 10:48:08.301366 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: X-Roles: admin,reader,member Aug 02 10:48:08.302898 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/b86f954a6cac457bad0b226e93315c59"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2/b86f954a6cac457bad0b226e93315c59"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/b86f954a6cac457bad0b226e93315c59"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.115:8080", "publicURL": "http://10.222.0.115:8080/v1/AUTH_b86f954a6cac457bad0b226e93315c59"}]}] Aug 02 10:48:08.302898 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: X-Tenant: admin Aug 02 10:48:08.302898 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: X-Tenant-Id: b86f954a6cac457bad0b226e93315c59 Aug 02 10:48:08.302898 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: X-Tenant-Name: admin Aug 02 10:48:08.302898 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: X-User: admin Aug 02 10:48:08.302898 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: X-User-Domain-Id: default Aug 02 10:48:08.302898 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: X-User-Domain-Name: Default Aug 02 10:48:08.302898 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: X-User-Id: 4fb0c392df554f5dbd68f6861be954a1 Aug 02 10:48:08.302898 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: X-User-Name: admin Aug 02 10:48:08.302898 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: method: > Aug 02 10:48:08.302898 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: exception: Flavor 42 could not be found. Aug 02 10:48:08.302898 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: action_args: {'id': '42'} Aug 02 10:48:08.302898 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: {{(pid=115423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:48:08.302898 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:48:08.304068 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 02 10:48:08.304068 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 02 10:48:08.304068 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 02 10:48:08.304068 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 02 10:48:08.304068 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 02 10:48:08.304068 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 02 10:48:08.304068 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 02 10:48:08.304068 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 02 10:48:08.304068 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 02 10:48:08.304068 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:48:08.304068 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 02 10:48:08.304068 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 02 10:48:08.304068 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 02 10:48:08.304068 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: ERROR nova.api.openstack.wsgi Aug 02 10:48:08.304068 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:48:08.304068 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: ERROR nova.api.openstack.wsgi Aug 02 10:48:08.304068 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:48:08.304068 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:48:08.304068 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:48:08.305954 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:48:08.305954 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:48:08.305954 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:48:08.305954 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:48:08.305954 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 02 10:48:08.305954 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 02 10:48:08.305954 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 02 10:48:08.305954 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: ERROR nova.api.openstack.wsgi Aug 02 10:48:08.305954 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:48:08.305954 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: ERROR nova.api.openstack.wsgi Aug 02 10:48:08.305954 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:48:08.305954 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:48:08.305954 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:48:08.305954 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:48:08.305954 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:48:08.305954 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 02 10:48:08.305954 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: ERROR nova.api.openstack.wsgi Aug 02 10:48:08.305954 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi [None req-c1df50b4-67d4-4217-911f-11683aab5aa1 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=115423) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:48:08.307300 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: INFO nova.api.openstack.requestlog [None req-c1df50b4-67d4-4217-911f-11683aab5aa1 admin admin] 10.222.0.115 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015021 Aug 02 10:48:08.307300 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: [pid: 115423|app: 0|req: 22/42] 10.222.0.115 () {60 vars in 1195 bytes} [Tue Aug 2 10:48:08 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 02 10:48:09.316931 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi [None req-f01a6a58-cf74-443d-97da-543af5610b85 admin admin] Calling method '>' {{(pid=115422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:48:09.318657 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: INFO nova.api.openstack.requestlog [None req-f01a6a58-cf74-443d-97da-543af5610b85 admin admin] 10.222.0.115 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.002453 Aug 02 10:48:09.319370 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: [pid: 115422|app: 0|req: 21/43] 10.222.0.115 () {56 vars in 1079 bytes} [Tue Aug 2 10:48:09 2022] GET /compute/v2.1 => generated 389 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:48:09.868802 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi [None req-235be1db-4b16-41d7-ad85-8ee296dea5d0 admin admin] Calling method '>' {{(pid=115423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:48:09.875330 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: INFO nova.api.openstack.wsgi [None req-235be1db-4b16-41d7-ad85-8ee296dea5d0 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 02 10:48:09.876870 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi [None req-235be1db-4b16-41d7-ad85-8ee296dea5d0 admin admin] Request method failure captured: Aug 02 10:48:09.876870 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 02 10:48:09.876870 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: Accept: application/json Aug 02 10:48:09.876870 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: Accept-Encoding: gzip, deflate Aug 02 10:48:09.876870 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: Connection: keep-alive Aug 02 10:48:09.876870 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: Content-Length: 0 Aug 02 10:48:09.876870 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: Host: 10.222.0.115 Aug 02 10:48:09.876870 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: Openstack-Api-Version: compute 2.90 Aug 02 10:48:09.876870 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: Openstack-System-Scope: None Aug 02 10:48:09.876870 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: User-Agent: python-novaclient Aug 02 10:48:09.876870 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: X-Auth-Token: gAAAAABi6QDpcmpBwyW5_Wr1IeTGLNkahD2N5ll106AicDkeOARdbI-eiBv4rOzFDEJHyDFrc8MIuwfH9Lutc0wI9z6cQ9u414kwozjrJp6e-2dvY5DrumEoUSM3jbuebtnym4EOtA1HTc73siwv31zLZA6wHq_o6NNEj8dGWbjIwsRevCmynpk Aug 02 10:48:09.876870 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: X-Domain-Id: None Aug 02 10:48:09.876870 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: X-Domain-Name: None Aug 02 10:48:09.876870 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: X-Identity-Status: Confirmed Aug 02 10:48:09.876870 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: X-Is-Admin-Project: True Aug 02 10:48:09.876870 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: X-Openstack-Nova-Api-Version: 2.90 Aug 02 10:48:09.876870 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: X-Project-Domain-Id: default Aug 02 10:48:09.876870 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: X-Project-Domain-Name: Default Aug 02 10:48:09.876870 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: X-Project-Id: b86f954a6cac457bad0b226e93315c59 Aug 02 10:48:09.876870 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: X-Project-Name: admin Aug 02 10:48:09.876870 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: X-Role: admin,reader,member Aug 02 10:48:09.876870 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: X-Roles: admin,reader,member Aug 02 10:48:09.878494 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/b86f954a6cac457bad0b226e93315c59"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2/b86f954a6cac457bad0b226e93315c59"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/b86f954a6cac457bad0b226e93315c59"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.115:8080", "publicURL": "http://10.222.0.115:8080/v1/AUTH_b86f954a6cac457bad0b226e93315c59"}]}] Aug 02 10:48:09.878494 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: X-Tenant: admin Aug 02 10:48:09.878494 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: X-Tenant-Id: b86f954a6cac457bad0b226e93315c59 Aug 02 10:48:09.878494 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: X-Tenant-Name: admin Aug 02 10:48:09.878494 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: X-User: admin Aug 02 10:48:09.878494 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: X-User-Domain-Id: default Aug 02 10:48:09.878494 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: X-User-Domain-Name: Default Aug 02 10:48:09.878494 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: X-User-Id: 4fb0c392df554f5dbd68f6861be954a1 Aug 02 10:48:09.878494 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: X-User-Name: admin Aug 02 10:48:09.878494 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: method: > Aug 02 10:48:09.878494 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: exception: Flavor 84 could not be found. Aug 02 10:48:09.878494 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: action_args: {'id': '84'} Aug 02 10:48:09.878494 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: {{(pid=115423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:48:09.878494 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:48:09.879549 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 02 10:48:09.879549 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 02 10:48:09.879549 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 02 10:48:09.879549 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 02 10:48:09.879549 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 02 10:48:09.879549 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 02 10:48:09.879549 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 02 10:48:09.879549 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 02 10:48:09.879549 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 02 10:48:09.879549 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:48:09.879549 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 02 10:48:09.879549 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 02 10:48:09.879549 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 02 10:48:09.879549 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: ERROR nova.api.openstack.wsgi Aug 02 10:48:09.879549 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:48:09.879549 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: ERROR nova.api.openstack.wsgi Aug 02 10:48:09.879549 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:48:09.879549 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:48:09.879549 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:48:09.880969 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:48:09.880969 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:48:09.880969 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:48:09.880969 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:48:09.880969 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 02 10:48:09.880969 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 02 10:48:09.880969 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 02 10:48:09.880969 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: ERROR nova.api.openstack.wsgi Aug 02 10:48:09.880969 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:48:09.880969 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: ERROR nova.api.openstack.wsgi Aug 02 10:48:09.880969 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:48:09.880969 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:48:09.880969 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:48:09.880969 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:48:09.880969 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:48:09.880969 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 02 10:48:09.880969 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: ERROR nova.api.openstack.wsgi Aug 02 10:48:09.880969 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi [None req-235be1db-4b16-41d7-ad85-8ee296dea5d0 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=115423) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:48:09.882247 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: INFO nova.api.openstack.requestlog [None req-235be1db-4b16-41d7-ad85-8ee296dea5d0 admin admin] 10.222.0.115 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.412357 Aug 02 10:48:09.882247 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: [pid: 115423|app: 0|req: 23/44] 10.222.0.115 () {60 vars in 1195 bytes} [Tue Aug 2 10:48:09 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 413 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 02 10:48:09.888376 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi [None req-69aa8a89-13cb-41f1-ae62-8176134aa6bd admin admin] Calling method '>' {{(pid=115422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:48:09.904060 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: INFO nova.api.openstack.requestlog [None req-69aa8a89-13cb-41f1-ae62-8176134aa6bd admin admin] 10.222.0.115 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.019195 Aug 02 10:48:09.904627 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: [pid: 115422|app: 0|req: 22/45] 10.222.0.115 () {60 vars in 1215 bytes} [Tue Aug 2 10:48:09 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:48:09.914620 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi [None req-60116a24-04bd-468e-b6d9-7758f9f61a12 admin admin] Calling method '>' {{(pid=115423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:48:09.932395 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: INFO nova.api.openstack.requestlog [None req-60116a24-04bd-468e-b6d9-7758f9f61a12 admin admin] 10.222.0.115 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.021585 Aug 02 10:48:09.932945 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: [pid: 115423|app: 0|req: 24/46] 10.222.0.115 () {60 vars in 1215 bytes} [Tue Aug 2 10:48:09 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:48:09.943211 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi [None req-c4ab2c8d-cbd8-4984-9890-a571b4da48db admin admin] Calling method '>' {{(pid=115422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:48:09.948677 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: INFO nova.api.openstack.wsgi [None req-c4ab2c8d-cbd8-4984-9890-a571b4da48db admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 02 10:48:09.950173 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi [None req-c4ab2c8d-cbd8-4984-9890-a571b4da48db admin admin] Request method failure captured: Aug 02 10:48:09.950173 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 02 10:48:09.950173 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: Accept: application/json Aug 02 10:48:09.950173 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: Accept-Encoding: gzip, deflate Aug 02 10:48:09.950173 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: Connection: keep-alive Aug 02 10:48:09.950173 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: Content-Length: 0 Aug 02 10:48:09.950173 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: Host: 10.222.0.115 Aug 02 10:48:09.950173 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: Openstack-Api-Version: compute 2.90 Aug 02 10:48:09.950173 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: Openstack-System-Scope: None Aug 02 10:48:09.950173 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: User-Agent: python-novaclient Aug 02 10:48:09.950173 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: X-Auth-Token: gAAAAABi6QDpcmpBwyW5_Wr1IeTGLNkahD2N5ll106AicDkeOARdbI-eiBv4rOzFDEJHyDFrc8MIuwfH9Lutc0wI9z6cQ9u414kwozjrJp6e-2dvY5DrumEoUSM3jbuebtnym4EOtA1HTc73siwv31zLZA6wHq_o6NNEj8dGWbjIwsRevCmynpk Aug 02 10:48:09.950173 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: X-Domain-Id: None Aug 02 10:48:09.950173 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: X-Domain-Name: None Aug 02 10:48:09.950173 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: X-Identity-Status: Confirmed Aug 02 10:48:09.950173 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: X-Is-Admin-Project: True Aug 02 10:48:09.950173 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: X-Openstack-Nova-Api-Version: 2.90 Aug 02 10:48:09.950173 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: X-Project-Domain-Id: default Aug 02 10:48:09.950173 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: X-Project-Domain-Name: Default Aug 02 10:48:09.950173 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: X-Project-Id: b86f954a6cac457bad0b226e93315c59 Aug 02 10:48:09.950173 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: X-Project-Name: admin Aug 02 10:48:09.950173 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: X-Role: admin,reader,member Aug 02 10:48:09.950173 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: X-Roles: admin,reader,member Aug 02 10:48:09.952122 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/b86f954a6cac457bad0b226e93315c59"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2/b86f954a6cac457bad0b226e93315c59"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/b86f954a6cac457bad0b226e93315c59"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.115:8080", "publicURL": "http://10.222.0.115:8080/v1/AUTH_b86f954a6cac457bad0b226e93315c59"}]}] Aug 02 10:48:09.952122 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: X-Tenant: admin Aug 02 10:48:09.952122 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: X-Tenant-Id: b86f954a6cac457bad0b226e93315c59 Aug 02 10:48:09.952122 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: X-Tenant-Name: admin Aug 02 10:48:09.952122 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: X-User: admin Aug 02 10:48:09.952122 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: X-User-Domain-Id: default Aug 02 10:48:09.952122 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: X-User-Domain-Name: Default Aug 02 10:48:09.952122 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: X-User-Id: 4fb0c392df554f5dbd68f6861be954a1 Aug 02 10:48:09.952122 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: X-User-Name: admin Aug 02 10:48:09.952122 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: method: > Aug 02 10:48:09.952122 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: exception: Flavor 84 could not be found. Aug 02 10:48:09.952122 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: action_args: {'id': '84'} Aug 02 10:48:09.952122 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: {{(pid=115422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:48:09.952122 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:48:09.952999 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 02 10:48:09.952999 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 02 10:48:09.952999 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 02 10:48:09.952999 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 02 10:48:09.952999 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 02 10:48:09.952999 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 02 10:48:09.952999 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 02 10:48:09.952999 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 02 10:48:09.952999 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 02 10:48:09.952999 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:48:09.952999 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 02 10:48:09.952999 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 02 10:48:09.952999 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 02 10:48:09.952999 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: ERROR nova.api.openstack.wsgi Aug 02 10:48:09.952999 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:48:09.952999 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: ERROR nova.api.openstack.wsgi Aug 02 10:48:09.952999 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:48:09.952999 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:48:09.952999 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:48:09.954398 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:48:09.954398 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:48:09.954398 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:48:09.954398 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:48:09.954398 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 02 10:48:09.954398 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 02 10:48:09.954398 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 02 10:48:09.954398 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: ERROR nova.api.openstack.wsgi Aug 02 10:48:09.954398 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:48:09.954398 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: ERROR nova.api.openstack.wsgi Aug 02 10:48:09.954398 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:48:09.954398 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:48:09.954398 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:48:09.954398 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:48:09.954398 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:48:09.954398 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 02 10:48:09.954398 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: ERROR nova.api.openstack.wsgi Aug 02 10:48:09.954398 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi [None req-c4ab2c8d-cbd8-4984-9890-a571b4da48db admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=115422) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:48:09.955747 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: INFO nova.api.openstack.requestlog [None req-c4ab2c8d-cbd8-4984-9890-a571b4da48db admin admin] 10.222.0.115 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012086 Aug 02 10:48:09.955747 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: [pid: 115422|app: 0|req: 23/47] 10.222.0.115 () {60 vars in 1195 bytes} [Tue Aug 2 10:48:09 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 02 10:48:10.928829 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi [None req-60116a24-04bd-468e-b6d9-7758f9f61a12 admin admin] Calling method '>' {{(pid=115423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:48:10.930091 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: INFO nova.api.openstack.requestlog [None req-60116a24-04bd-468e-b6d9-7758f9f61a12 admin admin] 10.222.0.115 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001686 Aug 02 10:48:10.930486 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: [pid: 115423|app: 0|req: 25/48] 10.222.0.115 () {56 vars in 1079 bytes} [Tue Aug 2 10:48:10 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:48:11.474453 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi [None req-a243c4c9-b468-42ac-894f-024628f3d90e admin admin] Calling method '>' {{(pid=115422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:48:11.480496 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: INFO nova.api.openstack.wsgi [None req-a243c4c9-b468-42ac-894f-024628f3d90e admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 02 10:48:11.482172 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi [None req-a243c4c9-b468-42ac-894f-024628f3d90e admin admin] Request method failure captured: Aug 02 10:48:11.482172 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 02 10:48:11.482172 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: Accept: application/json Aug 02 10:48:11.482172 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: Accept-Encoding: gzip, deflate Aug 02 10:48:11.482172 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: Connection: keep-alive Aug 02 10:48:11.482172 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: Content-Length: 0 Aug 02 10:48:11.482172 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: Host: 10.222.0.115 Aug 02 10:48:11.482172 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: Openstack-Api-Version: compute 2.90 Aug 02 10:48:11.482172 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: Openstack-System-Scope: None Aug 02 10:48:11.482172 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: User-Agent: python-novaclient Aug 02 10:48:11.482172 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: X-Auth-Token: gAAAAABi6QDqSfxRpxZ1_mcWjlUObRc4WHBSPiwk-1ckZhf4Coous1XYUQuzcZddmZ8mK2xHedAxZN9Pe5NiX_i1qeuOL5gAfJ5ubEV8MElyOzhPn9ISro7Hz7JdZ0P3zUjc_j6YAQmkWB7OHDhLBFMHmVKN6jwAHSpQxgXm2IU3Gj38NopAwnQ Aug 02 10:48:11.482172 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: X-Domain-Id: None Aug 02 10:48:11.482172 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: X-Domain-Name: None Aug 02 10:48:11.482172 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: X-Identity-Status: Confirmed Aug 02 10:48:11.482172 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: X-Is-Admin-Project: True Aug 02 10:48:11.482172 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: X-Openstack-Nova-Api-Version: 2.90 Aug 02 10:48:11.482172 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: X-Project-Domain-Id: default Aug 02 10:48:11.482172 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: X-Project-Domain-Name: Default Aug 02 10:48:11.482172 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: X-Project-Id: b86f954a6cac457bad0b226e93315c59 Aug 02 10:48:11.482172 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: X-Project-Name: admin Aug 02 10:48:11.482172 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: X-Role: admin,reader,member Aug 02 10:48:11.482172 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: X-Roles: admin,reader,member Aug 02 10:48:11.483996 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/b86f954a6cac457bad0b226e93315c59"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2/b86f954a6cac457bad0b226e93315c59"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/b86f954a6cac457bad0b226e93315c59"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.115:8080", "publicURL": "http://10.222.0.115:8080/v1/AUTH_b86f954a6cac457bad0b226e93315c59"}]}] Aug 02 10:48:11.483996 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: X-Tenant: admin Aug 02 10:48:11.483996 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: X-Tenant-Id: b86f954a6cac457bad0b226e93315c59 Aug 02 10:48:11.483996 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: X-Tenant-Name: admin Aug 02 10:48:11.483996 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: X-User: admin Aug 02 10:48:11.483996 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: X-User-Domain-Id: default Aug 02 10:48:11.483996 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: X-User-Domain-Name: Default Aug 02 10:48:11.483996 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: X-User-Id: 4fb0c392df554f5dbd68f6861be954a1 Aug 02 10:48:11.483996 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: X-User-Name: admin Aug 02 10:48:11.483996 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: method: > Aug 02 10:48:11.483996 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: exception: Flavor 451 could not be found. Aug 02 10:48:11.483996 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: action_args: {'id': '451'} Aug 02 10:48:11.483996 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: {{(pid=115422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:48:11.483996 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:48:11.485158 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 02 10:48:11.485158 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 02 10:48:11.485158 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 02 10:48:11.485158 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 02 10:48:11.485158 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 02 10:48:11.485158 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 02 10:48:11.485158 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 02 10:48:11.485158 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 02 10:48:11.485158 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 02 10:48:11.485158 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:48:11.485158 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 02 10:48:11.485158 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 02 10:48:11.485158 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 02 10:48:11.485158 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: ERROR nova.api.openstack.wsgi Aug 02 10:48:11.485158 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:48:11.485158 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: ERROR nova.api.openstack.wsgi Aug 02 10:48:11.485158 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:48:11.485158 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:48:11.485158 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:48:11.486566 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:48:11.486566 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:48:11.486566 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:48:11.486566 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:48:11.486566 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 02 10:48:11.486566 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 02 10:48:11.486566 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 02 10:48:11.486566 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: ERROR nova.api.openstack.wsgi Aug 02 10:48:11.486566 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:48:11.486566 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: ERROR nova.api.openstack.wsgi Aug 02 10:48:11.486566 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:48:11.486566 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:48:11.486566 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:48:11.486566 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:48:11.486566 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:48:11.486566 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 02 10:48:11.486566 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: ERROR nova.api.openstack.wsgi Aug 02 10:48:11.486566 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi [None req-a243c4c9-b468-42ac-894f-024628f3d90e admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=115422) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:48:11.488217 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: INFO nova.api.openstack.requestlog [None req-a243c4c9-b468-42ac-894f-024628f3d90e admin admin] 10.222.0.115 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.415401 Aug 02 10:48:11.488217 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: [pid: 115422|app: 0|req: 24/49] 10.222.0.115 () {60 vars in 1198 bytes} [Tue Aug 2 10:48:11 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 416 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 02 10:48:11.493572 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi [None req-f5e9ae3f-fbd1-453d-add9-73980c33020f admin admin] Calling method '>' {{(pid=115423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:48:11.509175 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: INFO nova.api.openstack.requestlog [None req-f5e9ae3f-fbd1-453d-add9-73980c33020f admin admin] 10.222.0.115 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.019244 Aug 02 10:48:11.509707 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: [pid: 115423|app: 0|req: 26/50] 10.222.0.115 () {60 vars in 1215 bytes} [Tue Aug 2 10:48:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:48:11.519605 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi [None req-63becb62-2665-4e65-b2d0-8ad6bae5cb21 admin admin] Calling method '>' {{(pid=115422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:48:11.536196 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: INFO nova.api.openstack.requestlog [None req-63becb62-2665-4e65-b2d0-8ad6bae5cb21 admin admin] 10.222.0.115 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.019943 Aug 02 10:48:11.536761 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: [pid: 115422|app: 0|req: 25/51] 10.222.0.115 () {60 vars in 1215 bytes} [Tue Aug 2 10:48:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:48:11.546528 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi [None req-0fc27f40-b972-4aac-b9ca-c4111b61133d admin admin] Calling method '>' {{(pid=115423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:48:11.552114 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: INFO nova.api.openstack.wsgi [None req-0fc27f40-b972-4aac-b9ca-c4111b61133d admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 02 10:48:11.553653 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi [None req-0fc27f40-b972-4aac-b9ca-c4111b61133d admin admin] Request method failure captured: Aug 02 10:48:11.553653 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 02 10:48:11.553653 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: Accept: application/json Aug 02 10:48:11.553653 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: Accept-Encoding: gzip, deflate Aug 02 10:48:11.553653 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: Connection: keep-alive Aug 02 10:48:11.553653 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: Content-Length: 0 Aug 02 10:48:11.553653 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: Host: 10.222.0.115 Aug 02 10:48:11.553653 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: Openstack-Api-Version: compute 2.90 Aug 02 10:48:11.553653 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: Openstack-System-Scope: None Aug 02 10:48:11.553653 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: User-Agent: python-novaclient Aug 02 10:48:11.553653 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: X-Auth-Token: gAAAAABi6QDqSfxRpxZ1_mcWjlUObRc4WHBSPiwk-1ckZhf4Coous1XYUQuzcZddmZ8mK2xHedAxZN9Pe5NiX_i1qeuOL5gAfJ5ubEV8MElyOzhPn9ISro7Hz7JdZ0P3zUjc_j6YAQmkWB7OHDhLBFMHmVKN6jwAHSpQxgXm2IU3Gj38NopAwnQ Aug 02 10:48:11.553653 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: X-Domain-Id: None Aug 02 10:48:11.553653 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: X-Domain-Name: None Aug 02 10:48:11.553653 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: X-Identity-Status: Confirmed Aug 02 10:48:11.553653 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: X-Is-Admin-Project: True Aug 02 10:48:11.553653 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: X-Openstack-Nova-Api-Version: 2.90 Aug 02 10:48:11.553653 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: X-Project-Domain-Id: default Aug 02 10:48:11.553653 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: X-Project-Domain-Name: Default Aug 02 10:48:11.553653 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: X-Project-Id: b86f954a6cac457bad0b226e93315c59 Aug 02 10:48:11.553653 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: X-Project-Name: admin Aug 02 10:48:11.553653 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: X-Role: admin,reader,member Aug 02 10:48:11.553653 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: X-Roles: admin,reader,member Aug 02 10:48:11.555453 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/b86f954a6cac457bad0b226e93315c59"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2/b86f954a6cac457bad0b226e93315c59"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/b86f954a6cac457bad0b226e93315c59"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.115:8080", "publicURL": "http://10.222.0.115:8080/v1/AUTH_b86f954a6cac457bad0b226e93315c59"}]}] Aug 02 10:48:11.555453 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: X-Tenant: admin Aug 02 10:48:11.555453 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: X-Tenant-Id: b86f954a6cac457bad0b226e93315c59 Aug 02 10:48:11.555453 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: X-Tenant-Name: admin Aug 02 10:48:11.555453 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: X-User: admin Aug 02 10:48:11.555453 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: X-User-Domain-Id: default Aug 02 10:48:11.555453 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: X-User-Domain-Name: Default Aug 02 10:48:11.555453 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: X-User-Id: 4fb0c392df554f5dbd68f6861be954a1 Aug 02 10:48:11.555453 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: X-User-Name: admin Aug 02 10:48:11.555453 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: method: > Aug 02 10:48:11.555453 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: exception: Flavor 451 could not be found. Aug 02 10:48:11.555453 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: action_args: {'id': '451'} Aug 02 10:48:11.555453 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: {{(pid=115423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:48:11.555453 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:48:11.557402 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 02 10:48:11.557402 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 02 10:48:11.557402 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 02 10:48:11.557402 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 02 10:48:11.557402 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 02 10:48:11.557402 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 02 10:48:11.557402 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 02 10:48:11.557402 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 02 10:48:11.557402 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 02 10:48:11.557402 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:48:11.557402 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 02 10:48:11.557402 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 02 10:48:11.557402 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 02 10:48:11.557402 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: ERROR nova.api.openstack.wsgi Aug 02 10:48:11.557402 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:48:11.557402 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: ERROR nova.api.openstack.wsgi Aug 02 10:48:11.557402 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:48:11.557402 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:48:11.557402 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:48:11.558735 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:48:11.558735 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:48:11.558735 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:48:11.558735 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:48:11.558735 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 02 10:48:11.558735 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 02 10:48:11.558735 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 02 10:48:11.558735 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: ERROR nova.api.openstack.wsgi Aug 02 10:48:11.558735 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:48:11.558735 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: ERROR nova.api.openstack.wsgi Aug 02 10:48:11.558735 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:48:11.558735 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:48:11.558735 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:48:11.558735 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:48:11.558735 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:48:11.558735 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 02 10:48:11.558735 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: ERROR nova.api.openstack.wsgi Aug 02 10:48:11.558735 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi [None req-0fc27f40-b972-4aac-b9ca-c4111b61133d admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=115423) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:48:11.560488 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: INFO nova.api.openstack.requestlog [None req-0fc27f40-b972-4aac-b9ca-c4111b61133d admin admin] 10.222.0.115 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012530 Aug 02 10:48:11.560488 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: [pid: 115423|app: 0|req: 27/52] 10.222.0.115 () {60 vars in 1198 bytes} [Tue Aug 2 10:48:11 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 02 10:48:12.560989 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi [None req-63becb62-2665-4e65-b2d0-8ad6bae5cb21 admin admin] Calling method '>' {{(pid=115422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:48:12.562006 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: INFO nova.api.openstack.requestlog [None req-63becb62-2665-4e65-b2d0-8ad6bae5cb21 admin admin] 10.222.0.115 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001624 Aug 02 10:48:12.562402 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: [pid: 115422|app: 0|req: 26/53] 10.222.0.115 () {56 vars in 1079 bytes} [Tue Aug 2 10:48:12 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:48:13.106180 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi [None req-414593e1-f1c7-41b7-8a54-d09f3a0027e5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=115423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:48:13.206537 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: INFO nova.api.openstack.requestlog [None req-414593e1-f1c7-41b7-8a54-d09f3a0027e5 admin admin] 10.222.0.115 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.90 time: 0.504975 Aug 02 10:48:13.207115 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: [pid: 115423|app: 0|req: 28/54] 10.222.0.115 () {64 vars in 1240 bytes} [Tue Aug 2 10:48:12 2022] POST /compute/v2.1/flavors => generated 406 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 10:48:14.205390 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi [None req-63becb62-2665-4e65-b2d0-8ad6bae5cb21 admin admin] Calling method '>' {{(pid=115422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:48:14.206391 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: INFO nova.api.openstack.requestlog [None req-63becb62-2665-4e65-b2d0-8ad6bae5cb21 admin admin] 10.222.0.115 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001421 Aug 02 10:48:14.206785 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: [pid: 115422|app: 0|req: 27/55] 10.222.0.115 () {56 vars in 1079 bytes} [Tue Aug 2 10:48:14 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:48:14.790396 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi [None req-f426a60b-ee4a-4c42-9ee6-f5c31d748f83 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=115423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:48:14.856139 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: INFO nova.api.openstack.requestlog [None req-f426a60b-ee4a-4c42-9ee6-f5c31d748f83 admin admin] 10.222.0.115 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.506679 Aug 02 10:48:14.856702 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: [pid: 115423|app: 0|req: 29/56] 10.222.0.115 () {64 vars in 1240 bytes} [Tue Aug 2 10:48:14 2022] POST /compute/v2.1/flavors => generated 407 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:48:15.846248 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi [None req-63becb62-2665-4e65-b2d0-8ad6bae5cb21 admin admin] Calling method '>' {{(pid=115422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:48:15.847330 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: INFO nova.api.openstack.requestlog [None req-63becb62-2665-4e65-b2d0-8ad6bae5cb21 admin admin] 10.222.0.115 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001439 Aug 02 10:48:15.847770 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: [pid: 115422|app: 0|req: 28/57] 10.222.0.115 () {56 vars in 1079 bytes} [Tue Aug 2 10:48:15 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:48:16.426644 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi [None req-2a972e40-f330-41ca-835f-3f4cc8ec8835 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=115423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:48:16.533217 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: INFO nova.api.openstack.requestlog [None req-2a972e40-f330-41ca-835f-3f4cc8ec8835 admin admin] 10.222.0.115 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.547382 Aug 02 10:48:16.533762 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: [pid: 115423|app: 0|req: 30/58] 10.222.0.115 () {64 vars in 1240 bytes} [Tue Aug 2 10:48:15 2022] POST /compute/v2.1/flavors => generated 409 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:48:17.559025 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi [None req-63becb62-2665-4e65-b2d0-8ad6bae5cb21 admin admin] Calling method '>' {{(pid=115422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:48:17.560592 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: INFO nova.api.openstack.requestlog [None req-63becb62-2665-4e65-b2d0-8ad6bae5cb21 admin admin] 10.222.0.115 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.002061 Aug 02 10:48:17.560997 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: [pid: 115422|app: 0|req: 29/59] 10.222.0.115 () {56 vars in 1079 bytes} [Tue Aug 2 10:48:17 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:48:18.144471 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi [None req-847edd4f-8224-49d3-863d-2e62b9915d79 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=115423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:48:18.219030 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: INFO nova.api.openstack.requestlog [None req-847edd4f-8224-49d3-863d-2e62b9915d79 admin admin] 10.222.0.115 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.90 time: 0.512207 Aug 02 10:48:18.219615 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: [pid: 115423|app: 0|req: 31/60] 10.222.0.115 () {64 vars in 1240 bytes} [Tue Aug 2 10:48:17 2022] POST /compute/v2.1/flavors => generated 411 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:48:19.218444 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi [None req-63becb62-2665-4e65-b2d0-8ad6bae5cb21 admin admin] Calling method '>' {{(pid=115422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:48:19.219487 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: INFO nova.api.openstack.requestlog [None req-63becb62-2665-4e65-b2d0-8ad6bae5cb21 admin admin] 10.222.0.115 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001454 Aug 02 10:48:19.219885 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: [pid: 115422|app: 0|req: 30/61] 10.222.0.115 () {56 vars in 1079 bytes} [Tue Aug 2 10:48:19 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:48:19.768189 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi [None req-3c1c559c-2e59-4df3-ae73-c0b435e8433d admin admin] Calling method '>' {{(pid=115423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:48:19.790194 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: INFO nova.api.openstack.requestlog [None req-3c1c559c-2e59-4df3-ae73-c0b435e8433d admin admin] 10.222.0.115 "GET /compute/v2.1/flavors/detail" status: 200 len: 5805 microversion: 2.90 time: 0.431679 Aug 02 10:48:19.790757 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: [pid: 115423|app: 0|req: 32/62] 10.222.0.115 () {60 vars in 1207 bytes} [Tue Aug 2 10:48:19 2022] GET /compute/v2.1/flavors/detail => generated 5805 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:49:12.350838 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi [None req-63becb62-2665-4e65-b2d0-8ad6bae5cb21 admin admin] Calling method '>' {{(pid=115422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:49:12.351881 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: INFO nova.api.openstack.requestlog [None req-63becb62-2665-4e65-b2d0-8ad6bae5cb21 admin admin] 10.222.0.115 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001524 Aug 02 10:49:12.352283 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: [pid: 115422|app: 0|req: 31/63] 10.222.0.115 () {54 vars in 935 bytes} [Tue Aug 2 10:49:12 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:49:12.362873 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG dbcounter [-] [115423] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=115423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:49:12.772629 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi [None req-e72c2098-893a-439e-9691-d43ab5dad6eb admin admin] Calling method '>' {{(pid=115423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:49:12.794987 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: INFO nova.api.openstack.requestlog [None req-e72c2098-893a-439e-9691-d43ab5dad6eb admin admin] 10.222.0.115 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5819 microversion: 2.61 time: 0.436378 Aug 02 10:49:12.795501 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: [pid: 115423|app: 0|req: 33/64] 10.222.0.115 () {60 vars in 1296 bytes} [Tue Aug 2 10:49:12 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5819 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:49:12.817201 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG dbcounter [-] [115422] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=22,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=115422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:49:12.820802 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi [None req-5cc169ca-f751-43f1-9861-5f0b087a2395 admin admin] Calling method '>' {{(pid=115422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:49:12.828507 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: INFO nova.api.openstack.requestlog [None req-5cc169ca-f751-43f1-9861-5f0b087a2395 admin admin] 10.222.0.115 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013051 Aug 02 10:49:12.829090 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: [pid: 115422|app: 0|req: 32/65] 10.222.0.115 () {60 vars in 1287 bytes} [Tue Aug 2 10:49:12 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:49:12.841852 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi [None req-c629ad36-59bf-4523-9cf7-6f10b4ea8392 admin admin] Calling method '>' {{(pid=115423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:49:12.850074 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: INFO nova.api.openstack.requestlog [None req-c629ad36-59bf-4523-9cf7-6f10b4ea8392 admin admin] 10.222.0.115 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011795 Aug 02 10:49:12.850658 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: [pid: 115423|app: 0|req: 34/66] 10.222.0.115 () {60 vars in 1290 bytes} [Tue Aug 2 10:49:12 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:49:12.863798 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi [None req-ee8c73c0-2cac-482b-8771-080feb21adda admin admin] Calling method '>' {{(pid=115422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:49:12.872012 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: INFO nova.api.openstack.requestlog [None req-ee8c73c0-2cac-482b-8771-080feb21adda admin admin] 10.222.0.115 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011930 Aug 02 10:49:12.872551 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: [pid: 115422|app: 0|req: 33/67] 10.222.0.115 () {60 vars in 1290 bytes} [Tue Aug 2 10:49:12 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:49:12.884887 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi [None req-7888be6a-ea44-4d1c-9cd8-724b755e27a8 admin admin] Calling method '>' {{(pid=115423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:49:12.893001 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: INFO nova.api.openstack.requestlog [None req-7888be6a-ea44-4d1c-9cd8-724b755e27a8 admin admin] 10.222.0.115 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011931 Aug 02 10:49:12.893542 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: [pid: 115423|app: 0|req: 35/68] 10.222.0.115 () {60 vars in 1287 bytes} [Tue Aug 2 10:49:12 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:52:48.630722 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi [None req-ee8c73c0-2cac-482b-8771-080feb21adda admin admin] Calling method '>' {{(pid=115422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:52:48.632258 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: INFO nova.api.openstack.requestlog [None req-ee8c73c0-2cac-482b-8771-080feb21adda admin admin] 10.222.0.115 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001996 Aug 02 10:52:48.632657 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: [pid: 115422|app: 0|req: 34/69] 10.222.0.115 () {56 vars in 1079 bytes} [Tue Aug 2 10:52:48 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:52:48.780216 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG dbcounter [-] [115423] Writing DB stats nova_api:SELECT=6 {{(pid=115423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:52:48.934736 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi [None req-1fe59fde-52c5-485e-923c-f78e1e1af6e7 admin admin] Calling method '>' {{(pid=115423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:52:48.937057 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 10:52:48.937057 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: warnings.warn(msg) Aug 02 10:52:48.938253 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG oslo_concurrency.lockutils [None req-1fe59fde-52c5-485e-923c-f78e1e1af6e7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:52:48.938689 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG oslo_concurrency.lockutils [None req-1fe59fde-52c5-485e-923c-f78e1e1af6e7 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:52:48.939497 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG oslo_concurrency.lockutils [None req-1fe59fde-52c5-485e-923c-f78e1e1af6e7 admin admin] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:52:48.939922 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG oslo_concurrency.lockutils [None req-1fe59fde-52c5-485e-923c-f78e1e1af6e7 admin admin] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:52:48.974248 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: INFO nova.api.openstack.requestlog [None req-1fe59fde-52c5-485e-923c-f78e1e1af6e7 admin admin] 10.222.0.115 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.199149 Aug 02 10:52:48.974873 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: [pid: 115423|app: 0|req: 36/70] 10.222.0.115 () {60 vars in 1198 bytes} [Tue Aug 2 10:52:48 2022] GET /compute/v2.1/os-services => generated 791 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:52:49.835773 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi [None req-ee8c73c0-2cac-482b-8771-080feb21adda admin admin] Calling method '>' {{(pid=115422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:52:49.836834 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: INFO nova.api.openstack.requestlog [None req-ee8c73c0-2cac-482b-8771-080feb21adda admin admin] 10.222.0.115 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.002421 Aug 02 10:52:49.837232 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: [pid: 115422|app: 0|req: 35/71] 10.222.0.115 () {56 vars in 1079 bytes} [Tue Aug 2 10:52:49 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:52:50.038864 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi [None req-93346b27-bb19-45cd-9157-9cec7f60ecc0 admin admin] Calling method '>' {{(pid=115423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:52:50.041293 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 10:52:50.041293 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: warnings.warn(msg) Aug 02 10:52:50.042504 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG oslo_concurrency.lockutils [None req-93346b27-bb19-45cd-9157-9cec7f60ecc0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:52:50.042947 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG oslo_concurrency.lockutils [None req-93346b27-bb19-45cd-9157-9cec7f60ecc0 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:52:50.043760 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG oslo_concurrency.lockutils [None req-93346b27-bb19-45cd-9157-9cec7f60ecc0 admin admin] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:52:50.044190 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG oslo_concurrency.lockutils [None req-93346b27-bb19-45cd-9157-9cec7f60ecc0 admin admin] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:52:50.064354 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: INFO nova.api.openstack.requestlog [None req-93346b27-bb19-45cd-9157-9cec7f60ecc0 admin admin] 10.222.0.115 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.085770 Aug 02 10:52:50.064927 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: [pid: 115423|app: 0|req: 37/72] 10.222.0.115 () {60 vars in 1198 bytes} [Tue Aug 2 10:52:49 2022] GET /compute/v2.1/os-services => generated 791 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:53:01.322822 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi [None req-ee8c73c0-2cac-482b-8771-080feb21adda admin admin] Calling method '>' {{(pid=115422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:53:01.323868 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: INFO nova.api.openstack.requestlog [None req-ee8c73c0-2cac-482b-8771-080feb21adda admin admin] 10.222.0.115 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001466 Aug 02 10:53:01.324260 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: [pid: 115422|app: 0|req: 36/73] 10.222.0.115 () {56 vars in 1079 bytes} [Tue Aug 2 10:53:01 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:53:01.470706 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG dbcounter [-] [115423] Writing DB stats nova_cell0:SELECT=4 {{(pid=115423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:53:01.471594 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG dbcounter [-] [115423] Writing DB stats nova_cell1:SELECT=4 {{(pid=115423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:53:01.472220 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG dbcounter [-] [115423] Writing DB stats nova_api:SELECT=8 {{(pid=115423) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:53:01.523730 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi [None req-68ebf45e-da6c-4deb-b3de-329ffd7344f8 admin admin] Calling method '>' {{(pid=115423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:53:01.526073 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 10:53:01.526073 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: warnings.warn(msg) Aug 02 10:53:01.527287 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG oslo_concurrency.lockutils [None req-68ebf45e-da6c-4deb-b3de-329ffd7344f8 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:53:01.527715 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG oslo_concurrency.lockutils [None req-68ebf45e-da6c-4deb-b3de-329ffd7344f8 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:53:01.528504 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG oslo_concurrency.lockutils [None req-68ebf45e-da6c-4deb-b3de-329ffd7344f8 admin admin] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:53:01.528911 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG oslo_concurrency.lockutils [None req-68ebf45e-da6c-4deb-b3de-329ffd7344f8 admin admin] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:53:01.555608 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: INFO nova.api.openstack.requestlog [None req-68ebf45e-da6c-4deb-b3de-329ffd7344f8 admin admin] 10.222.0.115 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.088990 Aug 02 10:53:01.555903 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: [pid: 115423|app: 0|req: 38/74] 10.222.0.115 () {60 vars in 1198 bytes} [Tue Aug 2 10:53:01 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:53:02.400010 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: DEBUG nova.api.openstack.wsgi [None req-ee8c73c0-2cac-482b-8771-080feb21adda admin admin] Calling method '>' {{(pid=115422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:53:02.401087 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: INFO nova.api.openstack.requestlog [None req-ee8c73c0-2cac-482b-8771-080feb21adda admin admin] 10.222.0.115 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001696 Aug 02 10:53:02.401480 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: [pid: 115422|app: 0|req: 37/75] 10.222.0.115 () {56 vars in 1079 bytes} [Tue Aug 2 10:53:02 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:53:02.627910 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG nova.api.openstack.wsgi [None req-0ee9c51c-260b-4121-b925-74516814ff0f admin admin] Calling method '>' {{(pid=115423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:53:02.630552 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 10:53:02.630552 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: warnings.warn(msg) Aug 02 10:53:02.632215 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG oslo_concurrency.lockutils [None req-0ee9c51c-260b-4121-b925-74516814ff0f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:53:02.633334 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG oslo_concurrency.lockutils [None req-0ee9c51c-260b-4121-b925-74516814ff0f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:53:02.634590 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG oslo_concurrency.lockutils [None req-0ee9c51c-260b-4121-b925-74516814ff0f admin admin] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:53:02.635029 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: DEBUG oslo_concurrency.lockutils [None req-0ee9c51c-260b-4121-b925-74516814ff0f admin admin] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115423) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:53:02.659595 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: INFO nova.api.openstack.requestlog [None req-0ee9c51c-260b-4121-b925-74516814ff0f admin admin] 10.222.0.115 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.093679 Aug 02 10:53:02.660168 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: [pid: 115423|app: 0|req: 39/76] 10.222.0.115 () {60 vars in 1198 bytes} [Tue Aug 2 10:53:02 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:54:00.562630 dv-cinder-850318-6-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 02 10:54:00.563202 dv-cinder-850318-6-iscsi devstack@n-api.service[115421]: Tue Aug 2 10:54:00 2022 - graceful shutdown triggered... Aug 02 10:54:00.563650 dv-cinder-850318-6-iscsi devstack@n-api.service[115422]: Gracefully killing worker 1 (pid: 115422)... Aug 02 10:54:00.564011 dv-cinder-850318-6-iscsi devstack@n-api.service[115423]: Gracefully killing worker 2 (pid: 115423)... Aug 02 10:54:01.563180 dv-cinder-850318-6-iscsi devstack@n-api.service[115421]: worker 1 buried after 1 seconds Aug 02 10:54:01.563764 dv-cinder-850318-6-iscsi devstack@n-api.service[115421]: worker 2 buried after 1 seconds Aug 02 10:54:01.563764 dv-cinder-850318-6-iscsi devstack@n-api.service[115421]: goodbye to uWSGI. Aug 02 10:54:01.565357 dv-cinder-850318-6-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 02 10:54:01.566025 dv-cinder-850318-6-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 02 10:54:01.568888 dv-cinder-850318-6-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 02 10:54:01.580059 dv-cinder-850318-6-iscsi devstack@n-api.service[129935]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 02 10:54:01.583034 dv-cinder-850318-6-iscsi devstack@n-api.service[129935]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 2 10:54:01 2022] *** Aug 02 10:54:01.583034 dv-cinder-850318-6-iscsi devstack@n-api.service[129935]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 02 10:54:01.583034 dv-cinder-850318-6-iscsi devstack@n-api.service[129935]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 02 10:54:01.583034 dv-cinder-850318-6-iscsi devstack@n-api.service[129935]: nodename: dv-cinder-850318-6-iscsi Aug 02 10:54:01.583034 dv-cinder-850318-6-iscsi devstack@n-api.service[129935]: machine: x86_64 Aug 02 10:54:01.583034 dv-cinder-850318-6-iscsi devstack@n-api.service[129935]: clock source: unix Aug 02 10:54:01.583034 dv-cinder-850318-6-iscsi devstack@n-api.service[129935]: pcre jit disabled Aug 02 10:54:01.583034 dv-cinder-850318-6-iscsi devstack@n-api.service[129935]: detected number of CPU cores: 4 Aug 02 10:54:01.583034 dv-cinder-850318-6-iscsi devstack@n-api.service[129935]: current working directory: / Aug 02 10:54:01.583034 dv-cinder-850318-6-iscsi devstack@n-api.service[129935]: detected binary path: /usr/bin/uwsgi-core Aug 02 10:54:01.583034 dv-cinder-850318-6-iscsi devstack@n-api.service[129935]: your processes number limit is 47680 Aug 02 10:54:01.583034 dv-cinder-850318-6-iscsi devstack@n-api.service[129935]: your memory page size is 4096 bytes Aug 02 10:54:01.583921 dv-cinder-850318-6-iscsi devstack@n-api.service[129935]: detected max file descriptor number: 2048 Aug 02 10:54:01.583921 dv-cinder-850318-6-iscsi devstack@n-api.service[129935]: lock engine: pthread robust mutexes Aug 02 10:54:01.583921 dv-cinder-850318-6-iscsi devstack@n-api.service[129935]: thunder lock: enabled Aug 02 10:54:01.583921 dv-cinder-850318-6-iscsi devstack@n-api.service[129935]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 02 10:54:01.583921 dv-cinder-850318-6-iscsi devstack@n-api.service[129935]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 02 10:54:01.628823 dv-cinder-850318-6-iscsi devstack@n-api.service[129935]: Python main interpreter initialized at 0x5559f03d49c0 Aug 02 10:54:01.628823 dv-cinder-850318-6-iscsi devstack@n-api.service[129935]: python threads support enabled Aug 02 10:54:01.628823 dv-cinder-850318-6-iscsi devstack@n-api.service[129935]: your server socket listen backlog is limited to 100 connections Aug 02 10:54:01.628823 dv-cinder-850318-6-iscsi devstack@n-api.service[129935]: your mercy for graceful operations on workers is 90 seconds Aug 02 10:54:01.629318 dv-cinder-850318-6-iscsi devstack@n-api.service[129935]: mapped 403077 bytes (393 KB) for 2 cores Aug 02 10:54:01.629632 dv-cinder-850318-6-iscsi devstack@n-api.service[129935]: *** Operational MODE: preforking *** Aug 02 10:54:01.629950 dv-cinder-850318-6-iscsi devstack@n-api.service[129935]: *** uWSGI is running in multiple interpreter mode *** Aug 02 10:54:01.629950 dv-cinder-850318-6-iscsi devstack@n-api.service[129935]: spawned uWSGI master process (pid: 129935) Aug 02 10:54:01.630196 dv-cinder-850318-6-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 02 10:54:01.632551 dv-cinder-850318-6-iscsi devstack@n-api.service[129935]: spawned uWSGI worker 1 (pid: 129952, cores: 1) Aug 02 10:54:01.632884 dv-cinder-850318-6-iscsi devstack@n-api.service[129935]: spawned uWSGI worker 2 (pid: 129953, cores: 1) Aug 02 10:54:01.633225 dv-cinder-850318-6-iscsi devstack@n-api.service[129935]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 02 10:54:02.303327 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 02 10:54:02.304143 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 02 10:54:03.502697 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 02 10:54:03.502697 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: from cryptography.utils import int_from_bytes Aug 02 10:54:03.503543 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 02 10:54:03.503543 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: from cryptography.utils import int_from_bytes Aug 02 10:54:03.529198 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 02 10:54:03.529198 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: from cryptography.utils import int_from_bytes Aug 02 10:54:03.529771 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 02 10:54:03.529771 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: from cryptography.utils import int_from_bytes Aug 02 10:54:05.978996 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 02 10:54:05.979580 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 02 10:54:05.979789 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 02 10:54:05.980151 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 02 10:54:05.980408 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 02 10:54:05.980792 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:05.981119 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:05.981439 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:05.981753 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:05.982078 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:05.982385 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:05.982705 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:05.983022 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:05.983370 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:05.983628 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:05.983939 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:05.984259 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850318-6-iscsi {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:05.984576 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:05.985019 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:05.985332 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:05.985649 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:05.985953 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:05.986788 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:05.987336 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:05.987906 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 02 10:54:05.987906 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 02 10:54:05.988426 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:05.988568 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 02 10:54:05.988681 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:05.988789 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 02 10:54:05.988930 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:05.989058 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 02 10:54:05.989186 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:05.989305 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:05.989449 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:05.989588 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:05.989718 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:05.989853 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:05.989959 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:05.990060 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:05.990160 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:05.990313 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:05.990458 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:05.990629 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:05.990776 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:05.990953 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:05.991110 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:05.991318 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:05.991511 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850318-6-iscsi {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:05.991649 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:05.991831 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:05.991925 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:05.992146 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:05.992253 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:05.992459 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:05.992563 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850318-6-iscsi {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:05.992847 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:05.992947 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:05.993157 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:05.993307 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:05.993449 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:05.993580 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:05.993770 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:05.993872 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:05.994077 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:05.994187 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:05.994389 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:05.994492 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:05.994696 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:05.994806 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:05.995019 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:05.995228 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:05.995364 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:05.995545 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:05.995683 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:05.995855 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:05.995984 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:05.996188 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:05.996334 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:05.996515 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:05.996630 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:05.996831 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:05.996960 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:05.997144 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:05.997493 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:05.997613 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:05.997735 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:05.997735 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.001544 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.001679 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.002568 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.002707 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.002832 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.002954 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.003119 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850318-6-iscsi {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.003293 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.003448 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.003563 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.003674 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.003799 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.003912 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.004034 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.004034 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.004265 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.004389 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.004500 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.004610 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.004726 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.004844 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.004954 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.005078 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.005197 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.005314 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.005434 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.005545 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.005661 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.005783 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.005905 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.005905 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.006126 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.006243 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.006369 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.006491 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.006601 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.006720 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.006830 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.006944 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.007239 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.007370 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.007489 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.007611 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.007723 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.115 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.007840 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.007963 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.115 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.008081 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.008200 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.008319 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.008429 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.008548 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.008726 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.008847 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.008965 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.009085 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.009085 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.009322 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.009439 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.009556 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.009666 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.009793 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.009903 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.010040 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.010305 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.010466 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.010621 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.010766 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.010924 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.011117 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.011321 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.011471 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.011615 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.011764 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.011923 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.012067 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.012225 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.012369 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.012518 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.012709 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.012871 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.013026 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.013170 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.013312 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.013466 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.013616 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.013616 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.013898 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.014048 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.014225 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.014396 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.014555 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.115 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.014700 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.014849 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.115 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.014993 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.015242 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.015395 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.015554 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.015707 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.015858 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.016009 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.016170 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.016315 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.016472 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.016623 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.016767 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.016909 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.017057 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.017212 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.017366 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.017647 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.017873 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.018076 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.018238 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.018409 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.018569 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.018748 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.018912 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.019089 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.019255 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.019401 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.019550 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.019693 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.019846 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.019997 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.020160 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.020306 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.020459 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.020459 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.020744 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.020900 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.020900 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.021178 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.021322 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.021465 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.021621 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.021773 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.021917 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.022059 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.022202 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.022362 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.022522 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.022716 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.022869 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.023018 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.023194 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.023348 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.023509 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.023654 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.023804 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.023955 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.024109 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.024278 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.024445 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.024590 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.024741 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.024885 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.025027 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.025185 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.025329 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.025472 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.025630 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.025780 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.025923 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.026065 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.026218 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.026368 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.026524 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.026677 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.026829 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.026972 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.027147 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.027302 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.027459 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.027604 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.027755 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.027898 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.028041 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.028202 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.028347 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.028508 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.028661 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.028806 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.028949 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.029104 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.029250 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.029399 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.029554 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.029707 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.029862 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.030022 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.030192 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.030351 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.030504 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.030666 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.030812 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.030965 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.031200 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.031358 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.031514 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.031665 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.031824 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.031976 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.032132 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.032276 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.032426 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.032578 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.032736 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.032931 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.033132 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.033293 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.033446 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.033604 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.033761 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.033913 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.034058 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.034220 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.034372 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 10:54:06.034516 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.034668 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.034820 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.034965 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.035140 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.035298 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.035456 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.035601 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.035827 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.035983 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.036142 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.036285 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.036285 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.036578 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.036730 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.036880 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.037032 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.037176 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.037320 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.037471 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.037623 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.037766 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.037917 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.038082 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.038235 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.038388 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.038533 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.038688 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.038840 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.038984 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.039152 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.039313 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.039466 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.039617 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.039762 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.039905 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.040079 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.040261 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.040417 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.040562 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.040705 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.040847 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.041000 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.041151 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.041303 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.041453 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.041847 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.041998 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.041998 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.042338 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.042490 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.042646 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.042791 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.042973 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.043183 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.043331 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.043475 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.043618 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.043776 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.043934 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.044080 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.044235 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.044379 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.044522 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.044665 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.044816 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.044961 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.045104 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.045254 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.045407 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.045558 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.045711 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.045861 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.046013 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.046167 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.046318 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.046462 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.046619 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.046763 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.046906 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.047066 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.047216 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.047377 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.047529 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.047675 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.047818 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.047967 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.048128 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.048282 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.048426 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.048569 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.049250 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.049479 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.049696 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.049886 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.050033 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.050196 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.050352 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.050496 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.050647 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.050817 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.050963 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.051187 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.051349 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.051503 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.051662 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.051817 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.051962 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.052106 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.052255 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.052255 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.052550 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.052705 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.052868 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.053054 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.053203 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.053346 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.053502 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.053648 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.053799 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.053952 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.054096 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.054247 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.054399 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.054544 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.054707 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.054860 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.055012 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.055191 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.055346 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.055491 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.055635 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.055786 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.055931 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.056088 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.056234 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.056386 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.056590 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.056590 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.056889 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.057055 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.057209 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.057354 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.057505 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.057656 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.057801 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.057953 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.058098 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.058248 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.058400 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.058544 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.058708 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.058860 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.059005 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.059170 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.059325 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.059478 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.059631 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.059776 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.059927 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.060085 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.060234 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.060385 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.060549 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.060701 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.060852 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.060996 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.061139 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.061290 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.061444 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.061596 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.061747 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.061899 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.062043 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.062195 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.062348 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.062509 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.062661 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.062812 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.062956 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.063255 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.063410 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.063554 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.063697 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.063847 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.063999 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.064165 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.064311 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.065011 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.065206 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.065399 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.065561 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.065833 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.066603 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.066775 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.066925 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.067111 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.067264 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.067420 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.067576 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.067728 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.067880 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.068044 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.068205 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.068359 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.068513 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.068513 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.068799 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.068959 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.069116 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.069261 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.069420 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.069573 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.069717 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.069860 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.070027 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.070181 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.070333 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.070477 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.070621 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.070764 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.070921 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.071156 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.071360 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.071520 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.071667 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.071821 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.071977 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.072122 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.072272 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.072417 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.072559 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.072716 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.072869 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.073022 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.073219 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.073370 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.073515 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.073672 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.073827 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.073989 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.074141 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.074322 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.074477 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.074631 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.074776 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.074920 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.075093 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.075251 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.075411 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.075564 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.075716 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.075862 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.076022 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.076174 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.076328 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.076473 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.076616 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.076761 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.076904 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.077048 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.077204 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.077350 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.077500 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.077644 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.077794 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.077950 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.078103 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.078248 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.078398 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.078543 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.078693 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.078837 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.078989 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.078989 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.079355 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.079511 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.079656 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.079809 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.079996 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.080180 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.080348 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.080495 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.080737 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.081005 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.081163 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.081316 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.081468 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.081620 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.081764 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.081921 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.082078 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.082235 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.082380 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.082531 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.082675 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.082832 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.082977 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.083142 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.083327 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.083487 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.083642 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.083642 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.083932 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.084094 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.084094 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.084375 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.084529 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.084686 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.084844 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.084989 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.085131 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.085281 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.085440 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.085870 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.086024 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.086169 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.086323 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.086468 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.086620 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.086771 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.086924 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.087118 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.087269 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.087428 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.087580 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.087733 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.087877 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.088020 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.088170 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.088335 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.088481 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.088626 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.088776 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.088928 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.089073 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.089225 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.089369 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.089514 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.089665 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.089857 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.090021 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.090195 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.090369 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.090523 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.090523 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.090813 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.090813 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.091123 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.091283 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.091429 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.091581 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.091733 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.091891 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.091891 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.092183 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.092337 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.092501 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.092706 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.092862 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.093015 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.093168 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.093357 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.093508 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.093662 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.093809 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.093952 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.094095 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.094257 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.094402 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.094561 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.094720 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.094867 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.095018 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.095211 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.095368 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.095520 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.095711 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.095867 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.096110 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.096319 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.096482 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.096677 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.096906 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.097099 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.097259 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.097406 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.097550 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.097695 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.097847 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.097847 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.098192 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.098349 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.098349 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.098643 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.098796 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.098950 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.099126 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.099278 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.099430 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.099574 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.099718 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.099869 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.099869 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.100159 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.100317 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.100476 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.100621 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.100782 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.100936 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.101089 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.101243 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.101411 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.101583 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.102150 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.102355 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.102552 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.102740 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.102937 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.103309 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.103509 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.103660 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.103813 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.103975 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.104137 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.104298 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.104449 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.104607 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.104607 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.104955 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.105109 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.105270 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.105439 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.105591 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.105591 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.105901 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.106054 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.106212 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.106372 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.106523 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.106681 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.106847 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.107000 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.107174 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.107339 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.107490 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.107658 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.107818 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.107969 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.108126 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.108277 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.108428 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.108587 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.108747 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.108899 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.109048 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.109198 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.109369 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.109536 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.109695 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.109858 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.110011 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.110161 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.110451 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.110643 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.110831 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.111027 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.111838 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.112038 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.112317 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.112535 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.112723 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.113197 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.113444 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.113750 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.113923 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.114087 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.114240 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.114400 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.114559 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.114721 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.114892 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.115073 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.115244 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.115395 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.115547 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.115727 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.115880 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.116030 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.116189 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.116349 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.116507 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.116673 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.116834 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.116834 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.117140 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.117290 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.117448 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.117613 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.117772 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.117933 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.118091 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.118251 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.118409 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.118569 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.118569 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.118569 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.118569 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.119192 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.119356 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.119520 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.119679 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.119831 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.119990 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.120142 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.120301 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.120454 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.120612 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.120771 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.120937 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.121093 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.121263 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.121416 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.121573 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.121733 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.121893 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.122053 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.122220 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.122379 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.122537 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.122689 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.122846 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.123006 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.123224 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.123389 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.123540 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.123739 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.123896 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.124056 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.124222 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.124383 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.124534 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.124684 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.124834 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.124993 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.125147 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.125304 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.125473 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.125625 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.125783 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.125948 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.126100 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.126252 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.126410 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.126568 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.126726 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.127706 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.128003 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.128158 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.128372 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.128583 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.128793 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.128956 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.129116 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.129276 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.129429 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.129588 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.129754 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.129906 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.130056 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.130217 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.130370 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.130533 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.130699 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.130858 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.131010 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.131214 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.131377 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.131530 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.131700 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.131865 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.132017 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.132167 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.132316 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.132477 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.132639 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.132797 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.132948 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.133106 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.133265 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.133425 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.133578 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.133790 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.133949 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.134115 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.134275 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.134437 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.134590 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.134590 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.134887 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.135064 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.135064 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.135372 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.135524 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.135676 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.135825 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.135982 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.136142 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.136293 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.136450 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.136601 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.136770 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.136929 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.137158 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.137158 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.137158 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.137582 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.137733 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.137890 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.138053 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.138213 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.138372 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.138524 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.138696 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.138855 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.139015 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.139262 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.139425 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.139577 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.139727 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.139892 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.140053 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.140212 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.140409 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.140570 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.140728 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.140900 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.141059 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.141210 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.141369 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.141521 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.141687 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.141850 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.142009 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.142167 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.142363 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.143096 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.143330 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.143330 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.143721 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.143721 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.144065 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.144065 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.144372 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.144532 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.144684 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.144684 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.144983 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.145136 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.145300 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.145460 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.145623 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.145781 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.145941 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.146101 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.146263 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.146422 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.146574 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.146723 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.146881 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.147040 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.147248 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.147408 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.147568 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.147730 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.147888 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.148056 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.148210 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.148367 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.148526 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.148685 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.148836 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.148999 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.149151 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.149301 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.149458 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.149458 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.149763 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.149924 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.150081 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.150239 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.150391 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.150548 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.150548 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.150842 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.150993 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.151169 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.151320 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.151482 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.151653 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.151817 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.151967 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.152117 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.152281 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.152434 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.152598 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.152749 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.152899 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.153056 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.153205 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.153364 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.153529 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.153691 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.153849 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.154040 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.154210 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.154363 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.154523 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.154682 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.154841 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.154992 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.155194 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.155350 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.155508 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.155662 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.155823 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.155982 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.156148 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.156301 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.156452 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.156610 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.156761 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.156919 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.157084 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.157243 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.157351 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.157449 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.157537 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.157633 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.157720 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.157806 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.157900 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.158001 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.158111 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.158762 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.158762 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.158936 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.159112 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.159229 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.159329 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.159593 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.159731 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.159833 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.160006 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.160157 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.160261 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.160358 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.160358 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.160358 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.160606 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.160700 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.160843 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.160986 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.161183 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.161381 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.161586 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.161784 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.161989 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.162178 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.162178 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.162537 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.162728 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.162916 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.163152 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.163368 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.163588 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.163794 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.163999 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.164261 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.164261 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.164620 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.164808 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.164993 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.164993 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.165364 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.165553 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.165744 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.165933 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.165933 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.165933 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.165933 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.166897 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.167174 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.167174 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.167174 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.167685 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.167883 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.168066 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.168249 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.168429 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.168616 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.168811 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.169008 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.169187 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.169368 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.169548 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.169727 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.169923 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.170103 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.170297 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.170488 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.170683 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.170877 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.171102 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.171329 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.171519 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.171714 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.171898 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.172092 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.172288 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.172485 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.172678 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.172871 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.173051 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.173254 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.173438 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.173662 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.173909 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.174173 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.174388 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.174604 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.174785 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.174947 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.175140 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.175321 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.175508 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.175700 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.175881 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.176064 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.176249 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.176442 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.176632 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.176828 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.177009 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.177194 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.177386 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.177564 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.177758 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.177942 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.178134 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.178305 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.178499 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.178684 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.178884 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.179125 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.179340 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.179519 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.179707 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.179893 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.180103 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.180296 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.180503 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.180695 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.180877 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.181054 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.181251 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.181443 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.181644 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.181826 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.182017 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.182217 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.182407 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.182589 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.182778 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.182969 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.183178 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.183397 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.183589 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.183789 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.184004 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.184271 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.184485 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.184696 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.184696 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.185052 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.185241 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.185431 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.185600 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.185727 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.185727 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.185954 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.186074 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.186194 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.186314 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.186434 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.186547 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.186907 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.187035 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.187187 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.187320 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.187488 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.187628 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.187750 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.187869 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.187989 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.188111 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.188231 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.188350 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.188463 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.188573 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.188693 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.188811 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.188930 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.189043 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.189155 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.189273 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.189469 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.189469 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.189469 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.189469 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.190147 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.190321 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.190470 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.190666 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.190666 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.191036 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.191326 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.191473 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.191593 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.191705 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.191815 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.191925 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.192044 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.192237 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.192361 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.192473 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.192591 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.192703 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.192822 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.192941 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.193054 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.193164 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.193281 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.193394 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.193519 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.193632 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.193743 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.193861 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.193861 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.194121 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.194263 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.194445 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.194580 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.194727 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.194849 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.194970 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.195125 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.195251 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.195369 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.195489 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.195606 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.195726 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.195845 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.195957 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.195957 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.196170 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.196290 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.196409 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.196528 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.196646 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.196757 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.196875 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.196996 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.197107 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.197217 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.197326 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.197442 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.197555 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.197674 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.197793 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.197913 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.198025 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.198134 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.198243 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.198361 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.198472 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.198592 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.198711 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.198830 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.198947 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.199090 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.199221 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.199345 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.199473 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.199594 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.199718 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.199830 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.199948 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.200071 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.200183 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.200293 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.200413 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.200526 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.200636 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.200753 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.200865 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.200983 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.201103 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.201215 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.201331 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.201455 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.201574 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.201694 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.201819 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.201933 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.202043 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.202180 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.202414 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.202564 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.202680 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.202800 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.202919 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.203038 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.203232 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.203368 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.203488 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.203599 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.203708 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.203818 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.203935 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.204062 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.204196 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.204334 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.204505 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.204637 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.204771 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.204921 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.205582 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.205704 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.205823 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.205935 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.206059 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.206173 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.206292 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.206405 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.206515 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.206632 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.206753 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.206873 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.206985 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.207126 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.207262 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.207383 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.207503 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.207641 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.207761 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.207877 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.207996 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.208109 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.208109 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.208330 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.208440 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.208549 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.208658 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.208658 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.208872 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.208982 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.209099 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.209099 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.209305 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.209305 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.209527 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.209646 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.209757 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.209866 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.209975 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.210094 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.210211 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.210330 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.210482 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.210629 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.210759 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.210886 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.211005 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.211184 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.211299 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.211411 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.211530 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.211530 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.211736 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.211897 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.212022 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.212134 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.212253 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.212253 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.212481 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.212593 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.212702 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.212812 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.212931 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.213091 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.213227 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.213349 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.213349 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.213566 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.213684 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.213810 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.213929 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.214048 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.214167 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.214293 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.214427 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.214591 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.214724 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.214891 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.215027 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.215262 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.215395 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.215537 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.215702 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.215839 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.216020 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.216155 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.216333 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.216462 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.216647 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.216768 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.216959 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.217081 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.217272 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.217392 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.217584 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.217704 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.217896 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.218024 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.218208 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.218330 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.218519 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.218646 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.218830 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.218952 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.219165 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.219287 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.219486 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.219620 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.219814 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.219952 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.220127 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.220247 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.220440 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.220591 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.221353 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.221514 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.221805 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.221964 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.222202 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.222421 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.222568 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.222690 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.222826 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.223417 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.223607 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.223770 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.223917 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.224062 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.224214 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.224374 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.224528 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.224724 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.224875 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.225020 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.225749 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.225913 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.226060 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.226203 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.226357 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.226514 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.226665 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.226810 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.226953 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.227133 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.227295 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.227461 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.227616 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.227770 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.227923 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.228075 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.228075 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.228461 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.228636 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.228783 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.228928 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.229084 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.229239 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.229386 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.229538 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.229684 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.229836 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.229996 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.230151 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.230297 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.230459 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.230613 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.230758 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.230911 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.231083 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.231235 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.231379 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.231535 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.231696 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.231851 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.231996 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.232149 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.232293 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.232447 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.232617 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.232772 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.232929 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.233075 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.233220 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.233372 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.233527 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.233674 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.233829 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.233975 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.234127 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.234280 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.234450 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.234604 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.234802 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.234953 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.235161 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.235314 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.235471 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.235619 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.235764 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.235915 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.236061 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.236244 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.236997 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.237220 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.237402 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.237630 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.237864 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.238063 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.238212 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.238357 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.238502 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.238649 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.238794 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.238794 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.239109 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.239273 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.239418 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.239573 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.239729 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.239875 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.240026 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.240438 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.240593 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.240738 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.240847 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.240950 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.241038 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.241123 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.241217 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.241304 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.241304 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.241304 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.241545 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.241669 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.241799 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.241973 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.242119 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.242285 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.242617 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.242940 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.243151 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.243293 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.243492 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.243617 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.243844 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.243939 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.244169 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.244274 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.244492 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.244596 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.244819 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.244957 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.245139 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.245280 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.245456 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.245607 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.245771 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.245873 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.246090 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.246187 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.246405 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.246509 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.246717 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.246813 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.247035 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.247145 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.247380 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.247487 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.247701 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.247795 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.248031 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.248154 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.248347 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.248471 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.248680 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.248789 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.249012 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.249107 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.249367 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.249475 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.249686 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.249795 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.250001 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.250103 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.250314 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.250410 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.250633 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.250779 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.250943 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.251112 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.251279 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.251442 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.251620 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 02 10:54:06.251731 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.252560 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.252979 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.253531 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.253988 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.254325 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.254657 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.255013 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.255355 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.255706 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.256038 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.256354 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.256667 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.256974 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 10:54:06.257220 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 02 10:54:06.321165 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO dbcounter [None req-43bd28f5-f2ee-4abd-9299-bde14bf43498 None None] Registered counter for database nova_api Aug 02 10:54:06.343583 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_db.sqlalchemy.engines [None req-43bd28f5-f2ee-4abd-9299-bde14bf43498 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 10:54:06.351594 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG dbcounter [-] [129952] Writer thread running {{(pid=129952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 10:54:06.406305 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO dbcounter [None req-f3dddcf6-6469-4d3a-9f0a-b6b08ea6e92a None None] Registered counter for database nova_api Aug 02 10:54:06.411647 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.context [None req-43bd28f5-f2ee-4abd-9299-bde14bf43498 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8(cell1) {{(pid=129952) load_cells /opt/stack/nova/nova/context.py:464}} Aug 02 10:54:06.415794 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-43bd28f5-f2ee-4abd-9299-bde14bf43498 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:54:06.417965 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-43bd28f5-f2ee-4abd-9299-bde14bf43498 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:54:06.418751 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-43bd28f5-f2ee-4abd-9299-bde14bf43498 None None] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:54:06.420872 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-43bd28f5-f2ee-4abd-9299-bde14bf43498 None None] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:54:06.422844 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO dbcounter [None req-43bd28f5-f2ee-4abd-9299-bde14bf43498 None None] Registered counter for database nova_cell0 Aug 02 10:54:06.426751 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_db.sqlalchemy.engines [None req-f3dddcf6-6469-4d3a-9f0a-b6b08ea6e92a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129953) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 10:54:06.427568 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO dbcounter [None req-43bd28f5-f2ee-4abd-9299-bde14bf43498 None None] Registered counter for database nova_cell1 Aug 02 10:54:06.434085 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG dbcounter [-] [129953] Writer thread running {{(pid=129953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 10:54:06.437532 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_db.sqlalchemy.engines [None req-43bd28f5-f2ee-4abd-9299-bde14bf43498 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 10:54:06.442249 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_db.sqlalchemy.engines [None req-43bd28f5-f2ee-4abd-9299-bde14bf43498 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 10:54:06.443889 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG dbcounter [-] [129952] Writer thread running {{(pid=129952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 10:54:06.494350 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.context [None req-f3dddcf6-6469-4d3a-9f0a-b6b08ea6e92a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8(cell1) {{(pid=129953) load_cells /opt/stack/nova/nova/context.py:464}} Aug 02 10:54:06.498444 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-f3dddcf6-6469-4d3a-9f0a-b6b08ea6e92a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:54:06.500144 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-f3dddcf6-6469-4d3a-9f0a-b6b08ea6e92a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:54:06.500935 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-f3dddcf6-6469-4d3a-9f0a-b6b08ea6e92a None None] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:54:06.503899 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-f3dddcf6-6469-4d3a-9f0a-b6b08ea6e92a None None] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:54:06.505971 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO dbcounter [None req-f3dddcf6-6469-4d3a-9f0a-b6b08ea6e92a None None] Registered counter for database nova_cell0 Aug 02 10:54:06.510153 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO dbcounter [None req-f3dddcf6-6469-4d3a-9f0a-b6b08ea6e92a None None] Registered counter for database nova_cell1 Aug 02 10:54:06.517511 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_db.sqlalchemy.engines [None req-f3dddcf6-6469-4d3a-9f0a-b6b08ea6e92a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129953) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 10:54:06.520241 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_db.sqlalchemy.engines [None req-f3dddcf6-6469-4d3a-9f0a-b6b08ea6e92a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129953) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 10:54:06.526407 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG dbcounter [-] [129953] Writer thread running {{(pid=129953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 10:54:06.528069 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG dbcounter [-] [129953] Writer thread running {{(pid=129953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 10:54:06.592508 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG dbcounter [-] [129952] Writer thread running {{(pid=129952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 10:54:06.601659 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO dbcounter [None req-43bd28f5-f2ee-4abd-9299-bde14bf43498 None None] Registered counter for database nova_cell0 Aug 02 10:54:06.608562 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_db.sqlalchemy.engines [None req-43bd28f5-f2ee-4abd-9299-bde14bf43498 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 10:54:06.613144 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG dbcounter [-] [129952] Writer thread running {{(pid=129952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 10:54:06.679720 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO dbcounter [None req-f3dddcf6-6469-4d3a-9f0a-b6b08ea6e92a None None] Registered counter for database nova_cell0 Aug 02 10:54:06.686759 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_db.sqlalchemy.engines [None req-f3dddcf6-6469-4d3a-9f0a-b6b08ea6e92a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129953) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 10:54:06.692241 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG dbcounter [-] [129953] Writer thread running {{(pid=129953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 10:54:06.937166 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: WARNING keystonemiddleware.auth_token [None req-43bd28f5-f2ee-4abd-9299-bde14bf43498 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 02 10:54:06.945038 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: WARNING keystonemiddleware.auth_token [None req-43bd28f5-f2ee-4abd-9299-bde14bf43498 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 02 10:54:07.015500 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: WARNING keystonemiddleware.auth_token [None req-f3dddcf6-6469-4d3a-9f0a-b6b08ea6e92a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 02 10:54:07.023481 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: WARNING keystonemiddleware.auth_token [None req-f3dddcf6-6469-4d3a-9f0a-b6b08ea6e92a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 02 10:54:07.293850 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: WARNING keystonemiddleware.auth_token [None req-43bd28f5-f2ee-4abd-9299-bde14bf43498 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 02 10:54:07.300287 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: WARNING keystonemiddleware.auth_token [None req-43bd28f5-f2ee-4abd-9299-bde14bf43498 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 02 10:54:07.305822 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5559f03d49c0 pid: 129952 (default app) Aug 02 10:54:07.379990 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: WARNING keystonemiddleware.auth_token [None req-f3dddcf6-6469-4d3a-9f0a-b6b08ea6e92a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 02 10:54:07.385983 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: WARNING keystonemiddleware.auth_token [None req-f3dddcf6-6469-4d3a-9f0a-b6b08ea6e92a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 02 10:54:07.391303 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5559f03d49c0 pid: 129953 (default app) Aug 02 10:54:50.517281 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG dbcounter [-] [129952] Writing DB stats nova_api:SELECT=3 {{(pid=129952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:54:50.518964 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG dbcounter [-] [129952] Writing DB stats nova_cell1:SELECT=3 {{(pid=129952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:54:50.519948 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG dbcounter [-] [129952] Writing DB stats nova_cell0:SELECT=3 {{(pid=129952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:54:50.521064 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG dbcounter [-] [129952] Writing DB stats nova_cell0:SELECT=3 {{(pid=129952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:54:50.655587 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG dbcounter [-] [129953] Writing DB stats nova_api:SELECT=3 {{(pid=129953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:54:50.656920 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG dbcounter [-] [129953] Writing DB stats nova_cell1:SELECT=3 {{(pid=129953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:54:50.658108 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG dbcounter [-] [129953] Writing DB stats nova_cell0:SELECT=3 {{(pid=129953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:54:50.659521 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG dbcounter [-] [129953] Writing DB stats nova_cell0:SELECT=3 {{(pid=129953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:54:51.524787 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-c281bb57-306b-4703-bd2c-38d6d65d7731 tempest-VolumesGetTestJSON-1703558323 tempest-VolumesGetTestJSON-1703558323-project] Action: 'create', calling method: .version_select at 0x7f7c54e2af70>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-95448364", "metadata": {"Type": "work"}}} {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:54:51.649890 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-ae3fa284-87da-4158-ab0d-6d12215e7791 tempest-VolumesNegativeTest-1253902000 tempest-VolumesNegativeTest-1253902000-project] Action: 'create', calling method: .version_select at 0x7f7c54ddfe50>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1870619212", "metadata": {"Type": "work"}}} {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:54:51.662875 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-ae3fa284-87da-4158-ab0d-6d12215e7791 tempest-VolumesNegativeTest-1253902000 tempest-VolumesNegativeTest-1253902000-project] Request method failure captured: Aug 02 10:54:51.662875 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 02 10:54:51.662875 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Accept: application/json Aug 02 10:54:51.662875 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Accept-Encoding: identity Aug 02 10:54:51.662875 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Connection: close Aug 02 10:54:51.662875 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Content-Length: 122 Aug 02 10:54:51.662875 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Content-Type: application/json Aug 02 10:54:51.662875 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Host: 10.222.0.115 Aug 02 10:54:51.662875 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Openstack-System-Scope: None Aug 02 10:54:51.662875 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: User-Agent: python-urllib3/1.26.10 Aug 02 10:54:51.662875 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Auth-Token: gAAAAABi6QJ680ucEQfSTlkEuQJSn2o8GXfEo0FV5QpEXsbs7HTkTRidFXfq-UmJSJ99C9Do1sN3LjbHS8mldpUo9BdLx1dbhFFhwly1Ow2gvfwaZCfzX4pn9HPqiBJiPbicmb-bq1SpqfjzD5W6A9-aB8BegG3IPRq37MaZYHCKG2guzf9xUsc Aug 02 10:54:51.662875 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Domain-Id: None Aug 02 10:54:51.662875 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Domain-Name: None Aug 02 10:54:51.662875 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Identity-Status: Confirmed Aug 02 10:54:51.662875 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Is-Admin-Project: True Aug 02 10:54:51.662875 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Project-Domain-Id: default Aug 02 10:54:51.662875 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Project-Domain-Name: Default Aug 02 10:54:51.662875 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Project-Id: 98a5ee46ada143be8b05a26501f7a9d1 Aug 02 10:54:51.662875 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Project-Name: tempest-VolumesNegativeTest-1253902000 Aug 02 10:54:51.662875 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Role: reader,member Aug 02 10:54:51.662875 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Roles: reader,member Aug 02 10:54:51.667452 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/98a5ee46ada143be8b05a26501f7a9d1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2/98a5ee46ada143be8b05a26501f7a9d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/98a5ee46ada143be8b05a26501f7a9d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.115:8080", "publicURL": "http://10.222.0.115:8080/v1/AUTH_98a5ee46ada143be8b05a26501f7a9d1"}]}] Aug 02 10:54:51.667452 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Tenant: tempest-VolumesNegativeTest-1253902000 Aug 02 10:54:51.667452 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Tenant-Id: 98a5ee46ada143be8b05a26501f7a9d1 Aug 02 10:54:51.667452 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Tenant-Name: tempest-VolumesNegativeTest-1253902000 Aug 02 10:54:51.667452 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User: tempest-VolumesNegativeTest-1253902000-project Aug 02 10:54:51.667452 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User-Domain-Id: default Aug 02 10:54:51.667452 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User-Domain-Name: Default Aug 02 10:54:51.667452 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User-Id: f92f95f0b4e947518d84dbc161938110 Aug 02 10:54:51.667452 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User-Name: tempest-VolumesNegativeTest-1253902000-project Aug 02 10:54:51.667452 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Aug 02 10:54:51.667452 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1870619212", "metadata": {"Type": "work"}}} Aug 02 10:54:51.667452 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: method: Aug 02 10:54:51.667452 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 02 10:54:51.668467 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1870619212', 'metadata': {'Type': 'work'}}}} Aug 02 10:54:51.668467 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:54:51.668467 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:54:51.668467 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 02 10:54:51.668467 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 02 10:54:51.668467 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 02 10:54:51.668467 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi raise error Aug 02 10:54:51.668467 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 02 10:54:51.668467 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 10:54:51.668467 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 02 10:54:51.668467 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 02 10:54:51.668467 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 10:54:51.668467 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 02 10:54:51.668467 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi '#$%' Aug 02 10:54:51.668467 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 10:54:51.668467 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:54:51.668467 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 10:54:51.668467 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:54:51.668467 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:54:51.668467 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:54:51.668467 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:54:51.668467 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:54:51.670701 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 10:54:51.670701 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 10:54:51.670701 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:54:51.670701 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:54:51.670701 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 02 10:54:51.670701 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 02 10:54:51.670701 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 02 10:54:51.670701 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 02 10:54:51.670701 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 02 10:54:51.670701 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 02 10:54:51.670701 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 02 10:54:51.670701 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 10:54:51.670701 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:54:51.670701 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 10:54:51.670701 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:54:51.670701 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:54:51.670701 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:54:51.670701 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 02 10:54:51.670701 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 02 10:54:51.673443 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 02 10:54:51.673443 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 10:54:51.673443 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-ae3fa284-87da-4158-ab0d-6d12215e7791 tempest-VolumesNegativeTest-1253902000 tempest-VolumesNegativeTest-1253902000-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=129953) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:54:51.673443 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-ae3fa284-87da-4158-ab0d-6d12215e7791 tempest-VolumesNegativeTest-1253902000 tempest-VolumesNegativeTest-1253902000-project] 10.222.0.115 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.016564 Aug 02 10:54:51.673443 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 1/1] 10.222.0.115 () {60 vars in 1161 bytes} [Tue Aug 2 10:54:50 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1024 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 02 10:54:51.680865 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-70075c57-7a6f-4ba4-abfb-997e7cc816d6 tempest-VolumesNegativeTest-1253902000 tempest-VolumesNegativeTest-1253902000-project] Action: 'create', calling method: .version_select at 0x7f7c54cfb940>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1832289755", "metadata": {"Type": "work"}}} {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:54:51.685523 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-70075c57-7a6f-4ba4-abfb-997e7cc816d6 tempest-VolumesNegativeTest-1253902000 tempest-VolumesNegativeTest-1253902000-project] Request method failure captured: Aug 02 10:54:51.685523 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 02 10:54:51.685523 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Accept: application/json Aug 02 10:54:51.685523 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Accept-Encoding: identity Aug 02 10:54:51.685523 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Connection: close Aug 02 10:54:51.685523 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Content-Length: 120 Aug 02 10:54:51.685523 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Content-Type: application/json Aug 02 10:54:51.685523 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Host: 10.222.0.115 Aug 02 10:54:51.685523 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Openstack-System-Scope: None Aug 02 10:54:51.685523 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: User-Agent: python-urllib3/1.26.10 Aug 02 10:54:51.685523 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Auth-Token: gAAAAABi6QJ680ucEQfSTlkEuQJSn2o8GXfEo0FV5QpEXsbs7HTkTRidFXfq-UmJSJ99C9Do1sN3LjbHS8mldpUo9BdLx1dbhFFhwly1Ow2gvfwaZCfzX4pn9HPqiBJiPbicmb-bq1SpqfjzD5W6A9-aB8BegG3IPRq37MaZYHCKG2guzf9xUsc Aug 02 10:54:51.685523 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Domain-Id: None Aug 02 10:54:51.685523 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Domain-Name: None Aug 02 10:54:51.685523 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Identity-Status: Confirmed Aug 02 10:54:51.685523 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Is-Admin-Project: True Aug 02 10:54:51.685523 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Project-Domain-Id: default Aug 02 10:54:51.685523 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Project-Domain-Name: Default Aug 02 10:54:51.685523 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Project-Id: 98a5ee46ada143be8b05a26501f7a9d1 Aug 02 10:54:51.685523 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Project-Name: tempest-VolumesNegativeTest-1253902000 Aug 02 10:54:51.685523 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Role: reader,member Aug 02 10:54:51.685523 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Roles: reader,member Aug 02 10:54:51.687722 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/98a5ee46ada143be8b05a26501f7a9d1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2/98a5ee46ada143be8b05a26501f7a9d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/98a5ee46ada143be8b05a26501f7a9d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.115:8080", "publicURL": "http://10.222.0.115:8080/v1/AUTH_98a5ee46ada143be8b05a26501f7a9d1"}]}] Aug 02 10:54:51.687722 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Tenant: tempest-VolumesNegativeTest-1253902000 Aug 02 10:54:51.687722 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Tenant-Id: 98a5ee46ada143be8b05a26501f7a9d1 Aug 02 10:54:51.687722 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Tenant-Name: tempest-VolumesNegativeTest-1253902000 Aug 02 10:54:51.687722 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User: tempest-VolumesNegativeTest-1253902000-project Aug 02 10:54:51.687722 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User-Domain-Id: default Aug 02 10:54:51.687722 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User-Domain-Name: Default Aug 02 10:54:51.687722 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User-Id: f92f95f0b4e947518d84dbc161938110 Aug 02 10:54:51.687722 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User-Name: tempest-VolumesNegativeTest-1253902000-project Aug 02 10:54:51.687722 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Aug 02 10:54:51.687722 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1832289755", "metadata": {"Type": "work"}}} Aug 02 10:54:51.687722 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: method: Aug 02 10:54:51.687722 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 02 10:54:51.688671 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1832289755', 'metadata': {'Type': 'work'}}}} Aug 02 10:54:51.688671 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:54:51.688671 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:54:51.688671 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 02 10:54:51.688671 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 02 10:54:51.688671 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 02 10:54:51.688671 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi raise error Aug 02 10:54:51.688671 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 02 10:54:51.688671 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 10:54:51.688671 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 02 10:54:51.688671 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 02 10:54:51.688671 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 10:54:51.688671 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 02 10:54:51.688671 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi '0' Aug 02 10:54:51.688671 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 10:54:51.688671 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:54:51.688671 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 10:54:51.688671 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:54:51.688671 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:54:51.688671 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:54:51.688671 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:54:51.688671 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:54:51.690061 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 10:54:51.690061 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 10:54:51.690061 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:54:51.690061 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:54:51.690061 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 02 10:54:51.690061 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 02 10:54:51.690061 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 02 10:54:51.690061 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 02 10:54:51.690061 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 02 10:54:51.690061 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 02 10:54:51.690061 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 02 10:54:51.690061 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 10:54:51.690061 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:54:51.690061 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 10:54:51.690061 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:54:51.690061 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:54:51.690061 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:54:51.690061 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 02 10:54:51.690061 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 02 10:54:51.691820 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 02 10:54:51.691820 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 10:54:51.694371 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-70075c57-7a6f-4ba4-abfb-997e7cc816d6 tempest-VolumesNegativeTest-1253902000 tempest-VolumesNegativeTest-1253902000-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=129953) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:54:51.695633 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-70075c57-7a6f-4ba4-abfb-997e7cc816d6 tempest-VolumesNegativeTest-1253902000 tempest-VolumesNegativeTest-1253902000-project] 10.222.0.115 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.020427 Aug 02 10:54:51.702255 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 2/2] 10.222.0.115 () {60 vars in 1161 bytes} [Tue Aug 2 10:54:51 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 02 10:54:51.709506 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-bafac7b5-b7ae-4371-ac1b-9ff4f19eac8a tempest-VolumesNegativeTest-1253902000 tempest-VolumesNegativeTest-1253902000-project] Action: 'create', calling method: .version_select at 0x7f7c54cac9d0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-577709557", "metadata": {"Type": "work"}}} {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:54:51.714705 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-bafac7b5-b7ae-4371-ac1b-9ff4f19eac8a tempest-VolumesNegativeTest-1253902000 tempest-VolumesNegativeTest-1253902000-project] Request method failure captured: Aug 02 10:54:51.714705 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 02 10:54:51.714705 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Accept: application/json Aug 02 10:54:51.714705 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Accept-Encoding: identity Aug 02 10:54:51.714705 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Connection: close Aug 02 10:54:51.714705 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Content-Length: 118 Aug 02 10:54:51.714705 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Content-Type: application/json Aug 02 10:54:51.714705 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Host: 10.222.0.115 Aug 02 10:54:51.714705 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Openstack-System-Scope: None Aug 02 10:54:51.714705 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: User-Agent: python-urllib3/1.26.10 Aug 02 10:54:51.714705 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Auth-Token: gAAAAABi6QJ680ucEQfSTlkEuQJSn2o8GXfEo0FV5QpEXsbs7HTkTRidFXfq-UmJSJ99C9Do1sN3LjbHS8mldpUo9BdLx1dbhFFhwly1Ow2gvfwaZCfzX4pn9HPqiBJiPbicmb-bq1SpqfjzD5W6A9-aB8BegG3IPRq37MaZYHCKG2guzf9xUsc Aug 02 10:54:51.714705 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Domain-Id: None Aug 02 10:54:51.714705 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Domain-Name: None Aug 02 10:54:51.714705 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Identity-Status: Confirmed Aug 02 10:54:51.714705 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Is-Admin-Project: True Aug 02 10:54:51.714705 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Project-Domain-Id: default Aug 02 10:54:51.714705 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Project-Domain-Name: Default Aug 02 10:54:51.714705 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Project-Id: 98a5ee46ada143be8b05a26501f7a9d1 Aug 02 10:54:51.714705 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Project-Name: tempest-VolumesNegativeTest-1253902000 Aug 02 10:54:51.714705 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Role: reader,member Aug 02 10:54:51.714705 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Roles: reader,member Aug 02 10:54:51.724656 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/98a5ee46ada143be8b05a26501f7a9d1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2/98a5ee46ada143be8b05a26501f7a9d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/98a5ee46ada143be8b05a26501f7a9d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.115:8080", "publicURL": "http://10.222.0.115:8080/v1/AUTH_98a5ee46ada143be8b05a26501f7a9d1"}]}] Aug 02 10:54:51.724656 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Tenant: tempest-VolumesNegativeTest-1253902000 Aug 02 10:54:51.724656 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Tenant-Id: 98a5ee46ada143be8b05a26501f7a9d1 Aug 02 10:54:51.724656 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Tenant-Name: tempest-VolumesNegativeTest-1253902000 Aug 02 10:54:51.724656 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User: tempest-VolumesNegativeTest-1253902000-project Aug 02 10:54:51.724656 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User-Domain-Id: default Aug 02 10:54:51.724656 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User-Domain-Name: Default Aug 02 10:54:51.724656 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User-Id: f92f95f0b4e947518d84dbc161938110 Aug 02 10:54:51.724656 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User-Name: tempest-VolumesNegativeTest-1253902000-project Aug 02 10:54:51.724656 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Aug 02 10:54:51.724656 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-577709557", "metadata": {"Type": "work"}}} Aug 02 10:54:51.724656 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: method: Aug 02 10:54:51.724656 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 02 10:54:51.725466 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-577709557', 'metadata': {'Type': 'work'}}}} Aug 02 10:54:51.725466 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:54:51.725466 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:54:51.725466 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 02 10:54:51.725466 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 02 10:54:51.725466 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 02 10:54:51.725466 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi raise error Aug 02 10:54:51.725466 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 02 10:54:51.725466 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 10:54:51.725466 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 02 10:54:51.725466 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 02 10:54:51.725466 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 10:54:51.725466 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 02 10:54:51.725466 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi '' Aug 02 10:54:51.725466 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 10:54:51.725466 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:54:51.725466 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 10:54:51.725466 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:54:51.725466 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:54:51.725466 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:54:51.725466 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:54:51.725466 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:54:51.727246 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 10:54:51.727246 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 10:54:51.727246 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:54:51.727246 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:54:51.727246 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 02 10:54:51.727246 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 02 10:54:51.727246 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 02 10:54:51.727246 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 02 10:54:51.727246 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 02 10:54:51.727246 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 02 10:54:51.727246 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 02 10:54:51.727246 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 10:54:51.727246 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:54:51.727246 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 10:54:51.727246 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:54:51.727246 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:54:51.727246 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:54:51.727246 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 02 10:54:51.727246 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 02 10:54:51.728354 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 02 10:54:51.728354 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 10:54:51.728354 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-bafac7b5-b7ae-4371-ac1b-9ff4f19eac8a tempest-VolumesNegativeTest-1253902000 tempest-VolumesNegativeTest-1253902000-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=129953) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:54:51.728354 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-bafac7b5-b7ae-4371-ac1b-9ff4f19eac8a tempest-VolumesNegativeTest-1253902000 tempest-VolumesNegativeTest-1253902000-project] 10.222.0.115 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.012585 Aug 02 10:54:51.728354 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 3/3] 10.222.0.115 () {60 vars in 1161 bytes} [Tue Aug 2 10:54:51 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 02 10:54:51.737173 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-76dca0b4-d393-48e3-81b7-bcb0d87ed4da tempest-VolumesNegativeTest-1253902000 tempest-VolumesNegativeTest-1253902000-project] Calling method '.version_select at 0x7f7c54cac700>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:54:53.061154 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.wsgi [None req-76dca0b4-d393-48e3-81b7-bcb0d87ed4da tempest-VolumesNegativeTest-1253902000 tempest-VolumesNegativeTest-1253902000-project] HTTP exception thrown: Volume tempest-invalid-733038812 could not be found. Aug 02 10:54:53.061154 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-76dca0b4-d393-48e3-81b7-bcb0d87ed4da tempest-VolumesNegativeTest-1253902000 tempest-VolumesNegativeTest-1253902000-project] Request method failure captured: Aug 02 10:54:53.061154 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-733038812 HTTP/1.1 Aug 02 10:54:53.061154 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Accept: application/json Aug 02 10:54:53.061154 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Accept-Encoding: identity Aug 02 10:54:53.061154 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Connection: close Aug 02 10:54:53.061154 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Content-Length: 0 Aug 02 10:54:53.061154 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Content-Type: application/json Aug 02 10:54:53.061154 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Host: 10.222.0.115 Aug 02 10:54:53.061154 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Openstack-System-Scope: None Aug 02 10:54:53.061154 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: User-Agent: python-urllib3/1.26.10 Aug 02 10:54:53.061154 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Auth-Token: gAAAAABi6QJ680ucEQfSTlkEuQJSn2o8GXfEo0FV5QpEXsbs7HTkTRidFXfq-UmJSJ99C9Do1sN3LjbHS8mldpUo9BdLx1dbhFFhwly1Ow2gvfwaZCfzX4pn9HPqiBJiPbicmb-bq1SpqfjzD5W6A9-aB8BegG3IPRq37MaZYHCKG2guzf9xUsc Aug 02 10:54:53.061154 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Domain-Id: None Aug 02 10:54:53.061154 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Domain-Name: None Aug 02 10:54:53.061154 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Identity-Status: Confirmed Aug 02 10:54:53.061154 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Is-Admin-Project: True Aug 02 10:54:53.061154 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Project-Domain-Id: default Aug 02 10:54:53.061154 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Project-Domain-Name: Default Aug 02 10:54:53.061154 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Project-Id: 98a5ee46ada143be8b05a26501f7a9d1 Aug 02 10:54:53.061154 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Project-Name: tempest-VolumesNegativeTest-1253902000 Aug 02 10:54:53.061154 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Role: reader,member Aug 02 10:54:53.061154 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Roles: reader,member Aug 02 10:54:53.071021 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/98a5ee46ada143be8b05a26501f7a9d1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2/98a5ee46ada143be8b05a26501f7a9d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/98a5ee46ada143be8b05a26501f7a9d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.115:8080", "publicURL": "http://10.222.0.115:8080/v1/AUTH_98a5ee46ada143be8b05a26501f7a9d1"}]}] Aug 02 10:54:53.071021 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Tenant: tempest-VolumesNegativeTest-1253902000 Aug 02 10:54:53.071021 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Tenant-Id: 98a5ee46ada143be8b05a26501f7a9d1 Aug 02 10:54:53.071021 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Tenant-Name: tempest-VolumesNegativeTest-1253902000 Aug 02 10:54:53.071021 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User: tempest-VolumesNegativeTest-1253902000-project Aug 02 10:54:53.071021 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User-Domain-Id: default Aug 02 10:54:53.071021 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User-Domain-Name: Default Aug 02 10:54:53.071021 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User-Id: f92f95f0b4e947518d84dbc161938110 Aug 02 10:54:53.071021 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User-Name: tempest-VolumesNegativeTest-1253902000-project Aug 02 10:54:53.071021 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: method: Aug 02 10:54:53.071021 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: exception: Volume tempest-invalid-733038812 could not be found. Aug 02 10:54:53.071021 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: action_args: {'id': 'tempest-invalid-733038812'} Aug 02 10:54:53.071021 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:54:53.078262 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:54:53.078262 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 10:54:53.078262 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 10:54:53.078262 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 02 10:54:53.078262 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 02 10:54:53.078262 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 02 10:54:53.078262 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 02 10:54:53.078262 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 02 10:54:53.078262 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 02 10:54:53.078262 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 02 10:54:53.078262 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 02 10:54:53.078262 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 10:54:53.078262 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 10:54:53.078262 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 10:54:53.078262 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 10:54:53.078262 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-733038812 could not be found. (HTTP 404) (Request-ID: req-39a58f81-a929-477f-afe0-ce5d50e66b8f) Aug 02 10:54:53.078262 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 10:54:53.078262 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:54:53.078262 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 10:54:53.082456 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:54:53.082456 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 02 10:54:53.082456 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 02 10:54:53.082456 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 02 10:54:53.082456 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 02 10:54:53.082456 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 02 10:54:53.082456 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 02 10:54:53.082456 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 02 10:54:53.082456 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 02 10:54:53.082456 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 10:54:53.082456 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 10:54:53.082456 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 02 10:54:53.082456 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 02 10:54:53.082456 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 02 10:54:53.082456 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 02 10:54:53.082456 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 02 10:54:53.082456 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 02 10:54:53.082456 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 02 10:54:53.082456 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 02 10:54:53.087883 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 10:54:53.087883 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 10:54:53.087883 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 10:54:53.087883 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 10:54:53.087883 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-733038812 could not be found. Aug 02 10:54:53.087883 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 10:54:53.087883 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:54:53.087883 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 10:54:53.087883 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:54:53.087883 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:54:53.087883 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:54:53.087883 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:54:53.087883 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:54:53.087883 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 10:54:53.087883 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 10:54:53.087883 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:54:53.087883 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:54:53.087883 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 02 10:54:53.087883 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 10:54:53.087883 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-733038812 could not be found. Aug 02 10:54:53.091038 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 10:54:53.091038 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:54:53.091038 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 10:54:53.091038 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:54:53.091038 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:54:53.091038 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:54:53.091038 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:54:53.091038 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:54:53.091038 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-733038812 could not be found. Aug 02 10:54:53.091038 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 10:54:53.091038 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-76dca0b4-d393-48e3-81b7-bcb0d87ed4da tempest-VolumesNegativeTest-1253902000 tempest-VolumesNegativeTest-1253902000-project] Returning 404 to user: Volume tempest-invalid-733038812 could not be found. {{(pid=129953) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:54:53.091038 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-76dca0b4-d393-48e3-81b7-bcb0d87ed4da tempest-VolumesNegativeTest-1253902000 tempest-VolumesNegativeTest-1253902000-project] 10.222.0.115 "DELETE /compute/v2.1/os-volumes/tempest-invalid-733038812" status: 404 len: 98 microversion: 2.1 time: 1.254087 Aug 02 10:54:53.091038 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 4/4] 10.222.0.115 () {58 vars in 1220 bytes} [Tue Aug 2 10:54:51 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-733038812 => generated 98 bytes in 1257 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 02 10:54:53.092880 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-c42101c1-0028-4b64-b491-f86657d538eb tempest-VolumesNegativeTest-1253902000 tempest-VolumesNegativeTest-1253902000-project] 10.222.0.115 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.022303 Aug 02 10:54:53.092880 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 5/5] 10.222.0.115 () {58 vars in 1145 bytes} [Tue Aug 2 10:54:52 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 24 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 02 10:54:53.092880 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-9d3914c1-0a78-4019-83f4-d9d245440c5a tempest-VolumesNegativeTest-1253902000 tempest-VolumesNegativeTest-1253902000-project] 10.222.0.115 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005900 Aug 02 10:54:53.092880 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 6/6] 10.222.0.115 () {58 vars in 1142 bytes} [Tue Aug 2 10:54:53 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 13 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 02 10:54:53.092880 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-99b52eb8-f779-4490-b333-d766b34ff979 tempest-VolumesNegativeTest-1253902000 tempest-VolumesNegativeTest-1253902000-project] Calling method '.version_select at 0x7f7c54bebca0>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:54:53.138751 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.wsgi [None req-99b52eb8-f779-4490-b333-d766b34ff979 tempest-VolumesNegativeTest-1253902000 tempest-VolumesNegativeTest-1253902000-project] HTTP exception thrown: Volume 80ca6491-4010-4f23-805d-8a7e8ec8480c could not be found. Aug 02 10:54:53.138751 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-99b52eb8-f779-4490-b333-d766b34ff979 tempest-VolumesNegativeTest-1253902000 tempest-VolumesNegativeTest-1253902000-project] Request method failure captured: Aug 02 10:54:53.138751 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: request: DELETE /compute/v2.1/os-volumes/80ca6491-4010-4f23-805d-8a7e8ec8480c HTTP/1.1 Aug 02 10:54:53.138751 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Accept: application/json Aug 02 10:54:53.138751 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Accept-Encoding: identity Aug 02 10:54:53.138751 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Connection: close Aug 02 10:54:53.138751 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Content-Length: 0 Aug 02 10:54:53.138751 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Content-Type: application/json Aug 02 10:54:53.138751 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Host: 10.222.0.115 Aug 02 10:54:53.138751 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Openstack-System-Scope: None Aug 02 10:54:53.138751 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: User-Agent: python-urllib3/1.26.10 Aug 02 10:54:53.138751 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Auth-Token: gAAAAABi6QJ680ucEQfSTlkEuQJSn2o8GXfEo0FV5QpEXsbs7HTkTRidFXfq-UmJSJ99C9Do1sN3LjbHS8mldpUo9BdLx1dbhFFhwly1Ow2gvfwaZCfzX4pn9HPqiBJiPbicmb-bq1SpqfjzD5W6A9-aB8BegG3IPRq37MaZYHCKG2guzf9xUsc Aug 02 10:54:53.138751 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Domain-Id: None Aug 02 10:54:53.138751 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Domain-Name: None Aug 02 10:54:53.138751 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Identity-Status: Confirmed Aug 02 10:54:53.138751 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Is-Admin-Project: True Aug 02 10:54:53.138751 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Project-Domain-Id: default Aug 02 10:54:53.138751 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Project-Domain-Name: Default Aug 02 10:54:53.138751 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Project-Id: 98a5ee46ada143be8b05a26501f7a9d1 Aug 02 10:54:53.138751 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Project-Name: tempest-VolumesNegativeTest-1253902000 Aug 02 10:54:53.138751 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Role: reader,member Aug 02 10:54:53.138751 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Roles: reader,member Aug 02 10:54:53.141883 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/98a5ee46ada143be8b05a26501f7a9d1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2/98a5ee46ada143be8b05a26501f7a9d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/98a5ee46ada143be8b05a26501f7a9d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.115:8080", "publicURL": "http://10.222.0.115:8080/v1/AUTH_98a5ee46ada143be8b05a26501f7a9d1"}]}] Aug 02 10:54:53.141883 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Tenant: tempest-VolumesNegativeTest-1253902000 Aug 02 10:54:53.141883 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Tenant-Id: 98a5ee46ada143be8b05a26501f7a9d1 Aug 02 10:54:53.141883 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Tenant-Name: tempest-VolumesNegativeTest-1253902000 Aug 02 10:54:53.141883 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User: tempest-VolumesNegativeTest-1253902000-project Aug 02 10:54:53.141883 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User-Domain-Id: default Aug 02 10:54:53.141883 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User-Domain-Name: Default Aug 02 10:54:53.141883 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User-Id: f92f95f0b4e947518d84dbc161938110 Aug 02 10:54:53.141883 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User-Name: tempest-VolumesNegativeTest-1253902000-project Aug 02 10:54:53.141883 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: method: Aug 02 10:54:53.141883 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: exception: Volume 80ca6491-4010-4f23-805d-8a7e8ec8480c could not be found. Aug 02 10:54:53.141883 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: action_args: {'id': '80ca6491-4010-4f23-805d-8a7e8ec8480c'} Aug 02 10:54:53.141883 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:54:53.143548 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:54:53.143548 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 10:54:53.143548 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 10:54:53.143548 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 02 10:54:53.143548 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 02 10:54:53.143548 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 02 10:54:53.143548 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 02 10:54:53.143548 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 02 10:54:53.143548 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 02 10:54:53.143548 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 02 10:54:53.143548 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 02 10:54:53.143548 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 10:54:53.143548 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 10:54:53.143548 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 10:54:53.143548 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 10:54:53.143548 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 80ca6491-4010-4f23-805d-8a7e8ec8480c could not be found. (HTTP 404) (Request-ID: req-e999c328-5cb5-44c2-910f-28ed80d1bda7) Aug 02 10:54:53.143548 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 10:54:53.143548 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:54:53.143548 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 10:54:53.146374 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:54:53.146374 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 02 10:54:53.146374 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 02 10:54:53.146374 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 02 10:54:53.146374 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 02 10:54:53.146374 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 02 10:54:53.146374 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 02 10:54:53.146374 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 02 10:54:53.146374 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 02 10:54:53.146374 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 10:54:53.146374 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 10:54:53.146374 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 02 10:54:53.146374 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 02 10:54:53.146374 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 02 10:54:53.146374 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 02 10:54:53.146374 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 02 10:54:53.146374 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 02 10:54:53.146374 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 02 10:54:53.146374 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 02 10:54:53.148545 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 10:54:53.148545 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 10:54:53.148545 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 10:54:53.148545 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 10:54:53.148545 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 80ca6491-4010-4f23-805d-8a7e8ec8480c could not be found. Aug 02 10:54:53.148545 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 10:54:53.148545 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:54:53.148545 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 10:54:53.148545 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:54:53.148545 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:54:53.148545 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:54:53.148545 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:54:53.148545 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:54:53.148545 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 10:54:53.148545 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 10:54:53.148545 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:54:53.148545 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:54:53.148545 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 02 10:54:53.148545 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 10:54:53.149887 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 80ca6491-4010-4f23-805d-8a7e8ec8480c could not be found. Aug 02 10:54:53.149887 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 10:54:53.149887 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:54:53.149887 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 10:54:53.149887 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:54:53.149887 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:54:53.149887 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:54:53.149887 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:54:53.149887 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:54:53.149887 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 80ca6491-4010-4f23-805d-8a7e8ec8480c could not be found. Aug 02 10:54:53.149887 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 10:54:53.149887 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-99b52eb8-f779-4490-b333-d766b34ff979 tempest-VolumesNegativeTest-1253902000 tempest-VolumesNegativeTest-1253902000-project] Returning 404 to user: Volume 80ca6491-4010-4f23-805d-8a7e8ec8480c could not be found. {{(pid=129953) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:54:53.149887 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-99b52eb8-f779-4490-b333-d766b34ff979 tempest-VolumesNegativeTest-1253902000 tempest-VolumesNegativeTest-1253902000-project] 10.222.0.115 "DELETE /compute/v2.1/os-volumes/80ca6491-4010-4f23-805d-8a7e8ec8480c" status: 404 len: 109 microversion: 2.1 time: 0.095223 Aug 02 10:54:53.149887 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 7/7] 10.222.0.115 () {58 vars in 1253 bytes} [Tue Aug 2 10:54:53 2022] DELETE /compute/v2.1/os-volumes/80ca6491-4010-4f23-805d-8a7e8ec8480c => generated 109 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 10:54:53.150904 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-54338129-cd8d-4140-b9c0-5154ffbdb24b tempest-VolumesNegativeTest-1253902000 tempest-VolumesNegativeTest-1253902000-project] Calling method '.version_select at 0x7f7c54ccf790>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:54:53.183878 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.wsgi [None req-54338129-cd8d-4140-b9c0-5154ffbdb24b tempest-VolumesNegativeTest-1253902000 tempest-VolumesNegativeTest-1253902000-project] HTTP exception thrown: Volume a3e90c6a-69f9-4584-b2f5-064fdbc5f851 could not be found. Aug 02 10:54:53.185840 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-54338129-cd8d-4140-b9c0-5154ffbdb24b tempest-VolumesNegativeTest-1253902000 tempest-VolumesNegativeTest-1253902000-project] Request method failure captured: Aug 02 10:54:53.185840 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: request: GET /compute/v2.1/os-volumes/a3e90c6a-69f9-4584-b2f5-064fdbc5f851 HTTP/1.1 Aug 02 10:54:53.185840 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Accept: application/json Aug 02 10:54:53.185840 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Accept-Encoding: identity Aug 02 10:54:53.185840 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Connection: close Aug 02 10:54:53.185840 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Content-Length: 0 Aug 02 10:54:53.185840 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Content-Type: application/json Aug 02 10:54:53.185840 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Host: 10.222.0.115 Aug 02 10:54:53.185840 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Openstack-System-Scope: None Aug 02 10:54:53.185840 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: User-Agent: python-urllib3/1.26.10 Aug 02 10:54:53.185840 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Auth-Token: gAAAAABi6QJ680ucEQfSTlkEuQJSn2o8GXfEo0FV5QpEXsbs7HTkTRidFXfq-UmJSJ99C9Do1sN3LjbHS8mldpUo9BdLx1dbhFFhwly1Ow2gvfwaZCfzX4pn9HPqiBJiPbicmb-bq1SpqfjzD5W6A9-aB8BegG3IPRq37MaZYHCKG2guzf9xUsc Aug 02 10:54:53.185840 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Domain-Id: None Aug 02 10:54:53.185840 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Domain-Name: None Aug 02 10:54:53.185840 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Identity-Status: Confirmed Aug 02 10:54:53.185840 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Is-Admin-Project: True Aug 02 10:54:53.185840 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Project-Domain-Id: default Aug 02 10:54:53.185840 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Project-Domain-Name: Default Aug 02 10:54:53.185840 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Project-Id: 98a5ee46ada143be8b05a26501f7a9d1 Aug 02 10:54:53.185840 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Project-Name: tempest-VolumesNegativeTest-1253902000 Aug 02 10:54:53.185840 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Role: reader,member Aug 02 10:54:53.185840 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Roles: reader,member Aug 02 10:54:53.187460 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/98a5ee46ada143be8b05a26501f7a9d1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2/98a5ee46ada143be8b05a26501f7a9d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/98a5ee46ada143be8b05a26501f7a9d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.115:8080", "publicURL": "http://10.222.0.115:8080/v1/AUTH_98a5ee46ada143be8b05a26501f7a9d1"}]}] Aug 02 10:54:53.187460 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Tenant: tempest-VolumesNegativeTest-1253902000 Aug 02 10:54:53.187460 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Tenant-Id: 98a5ee46ada143be8b05a26501f7a9d1 Aug 02 10:54:53.187460 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Tenant-Name: tempest-VolumesNegativeTest-1253902000 Aug 02 10:54:53.187460 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User: tempest-VolumesNegativeTest-1253902000-project Aug 02 10:54:53.187460 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User-Domain-Id: default Aug 02 10:54:53.187460 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User-Domain-Name: Default Aug 02 10:54:53.187460 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User-Id: f92f95f0b4e947518d84dbc161938110 Aug 02 10:54:53.187460 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User-Name: tempest-VolumesNegativeTest-1253902000-project Aug 02 10:54:53.187460 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: method: Aug 02 10:54:53.187460 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: exception: Volume a3e90c6a-69f9-4584-b2f5-064fdbc5f851 could not be found. Aug 02 10:54:53.187460 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: action_args: {'id': 'a3e90c6a-69f9-4584-b2f5-064fdbc5f851'} Aug 02 10:54:53.187460 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:54:53.189284 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:54:53.189284 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 10:54:53.189284 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 10:54:53.189284 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 02 10:54:53.189284 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 02 10:54:53.189284 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 02 10:54:53.189284 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 02 10:54:53.189284 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 02 10:54:53.189284 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 02 10:54:53.189284 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 02 10:54:53.189284 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 02 10:54:53.189284 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 10:54:53.189284 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 10:54:53.189284 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 10:54:53.189284 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 10:54:53.189284 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a3e90c6a-69f9-4584-b2f5-064fdbc5f851 could not be found. (HTTP 404) (Request-ID: req-9e38de84-ec32-4553-a891-7ee14916d976) Aug 02 10:54:53.189284 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 10:54:53.189284 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:54:53.189284 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 10:54:53.192086 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:54:53.192086 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 02 10:54:53.192086 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 02 10:54:53.192086 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 02 10:54:53.192086 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 02 10:54:53.192086 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 02 10:54:53.192086 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 02 10:54:53.192086 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 02 10:54:53.192086 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 02 10:54:53.192086 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 10:54:53.192086 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 10:54:53.192086 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 02 10:54:53.192086 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 02 10:54:53.192086 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 02 10:54:53.192086 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 02 10:54:53.192086 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 02 10:54:53.192086 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 02 10:54:53.192086 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 02 10:54:53.192086 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 02 10:54:53.195494 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 10:54:53.195494 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 10:54:53.195494 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 10:54:53.195494 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 10:54:53.195494 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a3e90c6a-69f9-4584-b2f5-064fdbc5f851 could not be found. Aug 02 10:54:53.195494 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 10:54:53.195494 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:54:53.195494 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 10:54:53.195494 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:54:53.195494 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:54:53.195494 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:54:53.195494 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:54:53.195494 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:54:53.195494 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 10:54:53.195494 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 10:54:53.195494 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:54:53.195494 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:54:53.195494 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 02 10:54:53.195494 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 10:54:53.197450 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a3e90c6a-69f9-4584-b2f5-064fdbc5f851 could not be found. Aug 02 10:54:53.197450 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 10:54:53.197450 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:54:53.197450 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 10:54:53.197450 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:54:53.197450 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:54:53.197450 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:54:53.197450 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:54:53.197450 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:54:53.197450 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a3e90c6a-69f9-4584-b2f5-064fdbc5f851 could not be found. Aug 02 10:54:53.197450 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 10:54:53.197450 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-54338129-cd8d-4140-b9c0-5154ffbdb24b tempest-VolumesNegativeTest-1253902000 tempest-VolumesNegativeTest-1253902000-project] Returning 404 to user: Volume a3e90c6a-69f9-4584-b2f5-064fdbc5f851 could not be found. {{(pid=129953) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:54:53.197450 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-54338129-cd8d-4140-b9c0-5154ffbdb24b tempest-VolumesNegativeTest-1253902000 tempest-VolumesNegativeTest-1253902000-project] 10.222.0.115 "GET /compute/v2.1/os-volumes/a3e90c6a-69f9-4584-b2f5-064fdbc5f851" status: 404 len: 109 microversion: 2.1 time: 0.050312 Aug 02 10:54:53.197450 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 8/8] 10.222.0.115 () {58 vars in 1250 bytes} [Tue Aug 2 10:54:53 2022] GET /compute/v2.1/os-volumes/a3e90c6a-69f9-4584-b2f5-064fdbc5f851 => generated 109 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 10:54:53.626142 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-c281bb57-306b-4703-bd2c-38d6d65d7731 tempest-VolumesGetTestJSON-1703558323 tempest-VolumesGetTestJSON-1703558323-project] 10.222.0.115 "POST /compute/v2.1/os-volumes" status: 200 len: 351 microversion: 2.1 time: 3.123271 Aug 02 10:54:53.627222 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 1/9] 10.222.0.115 () {60 vars in 1161 bytes} [Tue Aug 2 10:54:50 2022] POST /compute/v2.1/os-volumes => generated 351 bytes in 3128 msecs (HTTP/1.1 200) 10 headers in 449 bytes (1 switches on core 0) Aug 02 10:54:53.642148 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-af6db8a2-0d5b-48fe-aa0a-13486dea78a9 tempest-VolumesGetTestJSON-1703558323 tempest-VolumesGetTestJSON-1703558323-project] Calling method '.version_select at 0x7f7c54ccf820>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:54:53.792738 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-af6db8a2-0d5b-48fe-aa0a-13486dea78a9 tempest-VolumesGetTestJSON-1703558323 tempest-VolumesGetTestJSON-1703558323-project] 10.222.0.115 "GET /compute/v2.1/os-volumes/5a4593c4-7a58-44b0-8a1f-60cb32e9658f" status: 200 len: 351 microversion: 2.1 time: 0.155613 Aug 02 10:54:53.793313 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 9/10] 10.222.0.115 () {58 vars in 1250 bytes} [Tue Aug 2 10:54:53 2022] GET /compute/v2.1/os-volumes/5a4593c4-7a58-44b0-8a1f-60cb32e9658f => generated 351 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:54:54.810465 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-fcaaae0c-dfac-4ee6-848f-91ef8b8871ef tempest-VolumesGetTestJSON-1703558323 tempest-VolumesGetTestJSON-1703558323-project] Calling method '.version_select at 0x7f7c54caadc0>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:54:54.906910 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-fcaaae0c-dfac-4ee6-848f-91ef8b8871ef tempest-VolumesGetTestJSON-1703558323 tempest-VolumesGetTestJSON-1703558323-project] 10.222.0.115 "GET /compute/v2.1/os-volumes/5a4593c4-7a58-44b0-8a1f-60cb32e9658f" status: 200 len: 352 microversion: 2.1 time: 0.095845 Aug 02 10:54:54.906910 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 2/11] 10.222.0.115 () {58 vars in 1250 bytes} [Tue Aug 2 10:54:54 2022] GET /compute/v2.1/os-volumes/5a4593c4-7a58-44b0-8a1f-60cb32e9658f => generated 352 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:54:54.915846 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-f9e08b10-8aa8-454e-a637-7e6552a38ee8 tempest-VolumesGetTestJSON-1703558323 tempest-VolumesGetTestJSON-1703558323-project] Calling method '.version_select at 0x7f7c54beb430>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:54:55.010711 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-f9e08b10-8aa8-454e-a637-7e6552a38ee8 tempest-VolumesGetTestJSON-1703558323 tempest-VolumesGetTestJSON-1703558323-project] 10.222.0.115 "GET /compute/v2.1/os-volumes/5a4593c4-7a58-44b0-8a1f-60cb32e9658f" status: 200 len: 352 microversion: 2.1 time: 0.098741 Aug 02 10:54:55.011580 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 10/12] 10.222.0.115 () {58 vars in 1250 bytes} [Tue Aug 2 10:54:54 2022] GET /compute/v2.1/os-volumes/5a4593c4-7a58-44b0-8a1f-60cb32e9658f => generated 352 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:54:55.026424 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-011b282c-8a8c-4e50-8ff3-8b288afd6625 tempest-VolumesGetTestJSON-1703558323 tempest-VolumesGetTestJSON-1703558323-project] Calling method '.version_select at 0x7f7c54cbc4c0>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:54:55.348215 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-011b282c-8a8c-4e50-8ff3-8b288afd6625 tempest-VolumesGetTestJSON-1703558323 tempest-VolumesGetTestJSON-1703558323-project] 10.222.0.115 "DELETE /compute/v2.1/os-volumes/5a4593c4-7a58-44b0-8a1f-60cb32e9658f" status: 202 len: 0 microversion: 2.1 time: 0.326217 Aug 02 10:54:55.349638 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 3/13] 10.222.0.115 () {58 vars in 1253 bytes} [Tue Aug 2 10:54:55 2022] DELETE /compute/v2.1/os-volumes/5a4593c4-7a58-44b0-8a1f-60cb32e9658f => generated 0 bytes in 328 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 10:54:55.370708 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-cae4d725-6974-47ef-88cc-6d467299f136 tempest-VolumesGetTestJSON-1703558323 tempest-VolumesGetTestJSON-1703558323-project] Calling method '.version_select at 0x7f7c54c00550>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:54:55.488595 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-cae4d725-6974-47ef-88cc-6d467299f136 tempest-VolumesGetTestJSON-1703558323 tempest-VolumesGetTestJSON-1703558323-project] 10.222.0.115 "GET /compute/v2.1/os-volumes/5a4593c4-7a58-44b0-8a1f-60cb32e9658f" status: 200 len: 351 microversion: 2.1 time: 0.134576 Aug 02 10:54:55.489735 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 11/14] 10.222.0.115 () {58 vars in 1250 bytes} [Tue Aug 2 10:54:55 2022] GET /compute/v2.1/os-volumes/5a4593c4-7a58-44b0-8a1f-60cb32e9658f => generated 351 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:54:56.502544 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-724afc60-23ae-4911-89d4-e9605107eb97 tempest-VolumesGetTestJSON-1703558323 tempest-VolumesGetTestJSON-1703558323-project] Calling method '.version_select at 0x7f7c54cbcb80>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:54:56.566252 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.wsgi [None req-724afc60-23ae-4911-89d4-e9605107eb97 tempest-VolumesGetTestJSON-1703558323 tempest-VolumesGetTestJSON-1703558323-project] HTTP exception thrown: Volume 5a4593c4-7a58-44b0-8a1f-60cb32e9658f could not be found. Aug 02 10:54:56.571085 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-724afc60-23ae-4911-89d4-e9605107eb97 tempest-VolumesGetTestJSON-1703558323 tempest-VolumesGetTestJSON-1703558323-project] Request method failure captured: Aug 02 10:54:56.571085 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: request: GET /compute/v2.1/os-volumes/5a4593c4-7a58-44b0-8a1f-60cb32e9658f HTTP/1.1 Aug 02 10:54:56.571085 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Accept: application/json Aug 02 10:54:56.571085 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Accept-Encoding: identity Aug 02 10:54:56.571085 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Connection: close Aug 02 10:54:56.571085 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Content-Length: 0 Aug 02 10:54:56.571085 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Content-Type: application/json Aug 02 10:54:56.571085 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Host: 10.222.0.115 Aug 02 10:54:56.571085 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Openstack-System-Scope: None Aug 02 10:54:56.571085 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: User-Agent: python-urllib3/1.26.10 Aug 02 10:54:56.571085 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Auth-Token: gAAAAABi6QJ6XhPBstv-TcjJyPP-9oSKvg-IO3vCcbH41UjfFS6fr9ijKO8wni-EKEIdleKLMxJiEEMru9yBI2KSpq6Vl_u8RJpX_1p2y_utTtM_O2YhhadND9hYNtfh7X8j8FzFL1JJSZuCtTGjs0diyL6zma-gMbHuHCYDo9C_upuF0GPHlJI Aug 02 10:54:56.571085 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Domain-Id: None Aug 02 10:54:56.571085 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Domain-Name: None Aug 02 10:54:56.571085 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Identity-Status: Confirmed Aug 02 10:54:56.571085 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Is-Admin-Project: True Aug 02 10:54:56.571085 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Project-Domain-Id: default Aug 02 10:54:56.571085 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Project-Domain-Name: Default Aug 02 10:54:56.571085 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Project-Id: 9d121c6b6fc44c4ca99caf69e4f57436 Aug 02 10:54:56.571085 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Project-Name: tempest-VolumesGetTestJSON-1703558323 Aug 02 10:54:56.571085 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Role: reader,member Aug 02 10:54:56.571085 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Roles: reader,member Aug 02 10:54:56.577897 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/9d121c6b6fc44c4ca99caf69e4f57436"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2/9d121c6b6fc44c4ca99caf69e4f57436"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/9d121c6b6fc44c4ca99caf69e4f57436"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.115:8080", "publicURL": "http://10.222.0.115:8080/v1/AUTH_9d121c6b6fc44c4ca99caf69e4f57436"}]}] Aug 02 10:54:56.577897 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Tenant: tempest-VolumesGetTestJSON-1703558323 Aug 02 10:54:56.577897 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Tenant-Id: 9d121c6b6fc44c4ca99caf69e4f57436 Aug 02 10:54:56.577897 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Tenant-Name: tempest-VolumesGetTestJSON-1703558323 Aug 02 10:54:56.577897 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User: tempest-VolumesGetTestJSON-1703558323-project Aug 02 10:54:56.577897 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User-Domain-Id: default Aug 02 10:54:56.577897 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User-Domain-Name: Default Aug 02 10:54:56.577897 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User-Id: 1dddc20f605b461a897a661942f381d7 Aug 02 10:54:56.577897 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User-Name: tempest-VolumesGetTestJSON-1703558323-project Aug 02 10:54:56.577897 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: method: Aug 02 10:54:56.577897 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: exception: Volume 5a4593c4-7a58-44b0-8a1f-60cb32e9658f could not be found. Aug 02 10:54:56.577897 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: action_args: {'id': '5a4593c4-7a58-44b0-8a1f-60cb32e9658f'} Aug 02 10:54:56.577897 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:54:56.579185 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:54:56.579185 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 10:54:56.579185 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 10:54:56.579185 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 02 10:54:56.579185 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 02 10:54:56.579185 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 02 10:54:56.579185 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 02 10:54:56.579185 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 02 10:54:56.579185 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 02 10:54:56.579185 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 02 10:54:56.579185 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 02 10:54:56.579185 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 10:54:56.579185 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 10:54:56.579185 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 10:54:56.579185 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 10:54:56.579185 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5a4593c4-7a58-44b0-8a1f-60cb32e9658f could not be found. (HTTP 404) (Request-ID: req-0a6df071-138f-4281-b0ee-5b92ef425e43) Aug 02 10:54:56.579185 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 10:54:56.579185 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:54:56.579185 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 10:54:56.580100 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:54:56.580100 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 02 10:54:56.580100 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 02 10:54:56.580100 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 02 10:54:56.580100 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 02 10:54:56.580100 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 02 10:54:56.580100 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 02 10:54:56.580100 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 02 10:54:56.580100 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 02 10:54:56.580100 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 10:54:56.580100 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 10:54:56.580100 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 02 10:54:56.580100 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 02 10:54:56.580100 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 02 10:54:56.580100 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 02 10:54:56.580100 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 02 10:54:56.580100 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 02 10:54:56.580100 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 02 10:54:56.580100 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 02 10:54:56.580983 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 10:54:56.580983 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 10:54:56.580983 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 10:54:56.580983 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 10:54:56.580983 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5a4593c4-7a58-44b0-8a1f-60cb32e9658f could not be found. Aug 02 10:54:56.580983 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 10:54:56.580983 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:54:56.580983 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 10:54:56.580983 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:54:56.580983 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:54:56.580983 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:54:56.580983 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:54:56.580983 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:54:56.580983 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 10:54:56.580983 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 10:54:56.580983 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:54:56.580983 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:54:56.580983 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 02 10:54:56.580983 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 10:54:56.581866 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5a4593c4-7a58-44b0-8a1f-60cb32e9658f could not be found. Aug 02 10:54:56.581866 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 10:54:56.581866 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:54:56.581866 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 10:54:56.581866 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:54:56.581866 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:54:56.581866 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:54:56.581866 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:54:56.581866 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:54:56.581866 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5a4593c4-7a58-44b0-8a1f-60cb32e9658f could not be found. Aug 02 10:54:56.581866 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 10:54:56.581866 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-724afc60-23ae-4911-89d4-e9605107eb97 tempest-VolumesGetTestJSON-1703558323 tempest-VolumesGetTestJSON-1703558323-project] Returning 404 to user: Volume 5a4593c4-7a58-44b0-8a1f-60cb32e9658f could not be found. {{(pid=129952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:54:56.581866 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-724afc60-23ae-4911-89d4-e9605107eb97 tempest-VolumesGetTestJSON-1703558323 tempest-VolumesGetTestJSON-1703558323-project] 10.222.0.115 "GET /compute/v2.1/os-volumes/5a4593c4-7a58-44b0-8a1f-60cb32e9658f" status: 404 len: 109 microversion: 2.1 time: 0.075304 Aug 02 10:54:56.581866 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 4/15] 10.222.0.115 () {58 vars in 1250 bytes} [Tue Aug 2 10:54:56 2022] GET /compute/v2.1/os-volumes/5a4593c4-7a58-44b0-8a1f-60cb32e9658f => generated 109 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 10:55:06.326667 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-63ef5714-3c55-416b-ae8d-5d84affa61b2 tempest-VolumesTestJSON-1075129769 tempest-VolumesTestJSON-1075129769-project] Calling method '.version_select at 0x7f7c54c00c10>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:06.675573 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-63ef5714-3c55-416b-ae8d-5d84affa61b2 tempest-VolumesTestJSON-1075129769 tempest-VolumesTestJSON-1075129769-project] 10.222.0.115 "GET /compute/v2.1/os-volumes/9c9b83a9-4705-4c10-8e2f-100499b8935a" status: 200 len: 350 microversion: 2.1 time: 0.354641 Aug 02 10:55:06.677731 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 12/16] 10.222.0.115 () {58 vars in 1250 bytes} [Tue Aug 2 10:55:06 2022] GET /compute/v2.1/os-volumes/9c9b83a9-4705-4c10-8e2f-100499b8935a => generated 350 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:55:07.651545 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-e757b340-c052-4a89-ad97-ab4418db1f9f tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1073037663", "imageRef": "aa0a7b8c-0dd6-4803-8767-cb8c2d05fdd4", "flavorRef": "452", "networks": [{"uuid": "6ed4b75f-77eb-4855-b268-9bd3f19bc29b"}]}} {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:55:07.890975 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.network.neutron [None req-e757b340-c052-4a89-ad97-ab4418db1f9f tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] validate_networks() for [('6ed4b75f-77eb-4855-b268-9bd3f19bc29b', None, None, None, None, None)] {{(pid=129952) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 10:55:09.786672 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-77a20c79-2d84-4047-9f58-362436ebf3f4 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Action: 'create', calling method: .version_select at 0x7f7c54c00670>, body: {"keypair": {"name": "tempest-keypair-955711744", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJuAI1gfpB1svMyErIK8mMbp0tcuuz9VSWbVXcNcrb1NV8V+x2/TNHYetaBsv7fra8TeRVVtjbxNvGHbkv1Dybswufeijlnseiu0Pqak98Qdub+zXad7palcJNPn85jmzg=="}} {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:55:09.947618 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.quota [None req-77a20c79-2d84-4047-9f58-362436ebf3f4 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Getting quotas for project 89a4a0cf1852449e8bfc59ddb5a902c1. Resources: {'key_pairs'} {{(pid=129953) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 10:55:09.984788 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.quota [None req-77a20c79-2d84-4047-9f58-362436ebf3f4 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Getting quotas for user 53bc14ada1564911b2f0a698aef3f333 and project 89a4a0cf1852449e8bfc59ddb5a902c1. Resources: {'key_pairs'} {{(pid=129953) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 10:55:10.245485 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-77a20c79-2d84-4047-9f58-362436ebf3f4 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.201077 Aug 02 10:55:10.253458 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 13/17] 10.222.0.115 () {60 vars in 1164 bytes} [Tue Aug 2 10:55:09 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:55:10.253458 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-2ed48af2-e602-465a-b7db-6c11a4cb7991 tempest-VolumesTestJSON-1075129769 tempest-VolumesTestJSON-1075129769-project] Calling method '.version_select at 0x7f7c54bd5940>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:10.355336 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-2ed48af2-e602-465a-b7db-6c11a4cb7991 tempest-VolumesTestJSON-1075129769 tempest-VolumesTestJSON-1075129769-project] 10.222.0.115 "GET /compute/v2.1/os-volumes/09f53464-1f95-4b32-9e8c-8033b4e95b53" status: 200 len: 351 microversion: 2.1 time: 0.107466 Aug 02 10:55:10.356937 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 14/18] 10.222.0.115 () {58 vars in 1250 bytes} [Tue Aug 2 10:55:10 2022] GET /compute/v2.1/os-volumes/09f53464-1f95-4b32-9e8c-8033b4e95b53 => generated 351 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:55:10.937630 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.virt.hardware [None req-e757b340-c052-4a89-ad97-ab4418db1f9f tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Flavor limits 0:0:0 {{(pid=129952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 10:55:10.938715 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.virt.hardware [None req-e757b340-c052-4a89-ad97-ab4418db1f9f tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Image limits 0:0:0 {{(pid=129952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 10:55:10.939418 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.virt.hardware [None req-e757b340-c052-4a89-ad97-ab4418db1f9f tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Flavor pref 0:0:0 {{(pid=129952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 10:55:10.939993 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.virt.hardware [None req-e757b340-c052-4a89-ad97-ab4418db1f9f tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Image pref 0:0:0 {{(pid=129952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 10:55:10.940572 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.virt.hardware [None req-e757b340-c052-4a89-ad97-ab4418db1f9f tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 10:55:10.970845 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-e757b340-c052-4a89-ad97-ab4418db1f9f tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:10.971615 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-e757b340-c052-4a89-ad97-ab4418db1f9f tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:10.973338 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-e757b340-c052-4a89-ad97-ab4418db1f9f tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:10.975441 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-e757b340-c052-4a89-ad97-ab4418db1f9f tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:11.060719 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.quota [None req-e757b340-c052-4a89-ad97-ab4418db1f9f tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Getting quotas for project 5ced4a8a26d94c10b08bbca381d62d34. Resources: {'instances', 'cores', 'ram'} {{(pid=129952) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 10:55:11.070012 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.quota [None req-e757b340-c052-4a89-ad97-ab4418db1f9f tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Getting quotas for user 822e6ac5ec8347c9815c770738509d30 and project 5ced4a8a26d94c10b08bbca381d62d34. Resources: {'instances', 'cores', 'ram'} {{(pid=129952) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 10:55:11.093145 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-e757b340-c052-4a89-ad97-ab4418db1f9f tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Going to run 1 instances... {{(pid=129952) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 10:55:11.096169 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-e757b340-c052-4a89-ad97-ab4418db1f9f tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] [instance: b4dbc5ca-f31e-44e8-9573-6e79e891b989] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aa0a7b8c-0dd6-4803-8767-cb8c2d05fdd4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129952) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 10:55:11.316794 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-e757b340-c052-4a89-ad97-ab4418db1f9f tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] 10.222.0.115 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 4.289947 Aug 02 10:55:11.317454 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 5/19] 10.222.0.115 () {60 vars in 1152 bytes} [Tue Aug 2 10:55:07 2022] POST /compute/v2.1/servers => generated 382 bytes in 4291 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 02 10:55:11.332263 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-31dbbf8d-f0f6-4c2c-ac5a-5bf1b84831e8 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:11.333585 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-31dbbf8d-f0f6-4c2c-ac5a-5bf1b84831e8 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] [instance: b4dbc5ca-f31e-44e8-9573-6e79e891b989] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:11.523448 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-31dbbf8d-f0f6-4c2c-ac5a-5bf1b84831e8 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822e6ac5ec8347c9815c770738509d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ced4a8a26d94c10b08bbca381d62d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:11.585027 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-31dbbf8d-f0f6-4c2c-ac5a-5bf1b84831e8 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] 10.222.0.115 "GET /compute/v2.1/servers/b4dbc5ca-f31e-44e8-9573-6e79e891b989" status: 200 len: 1219 microversion: 2.1 time: 0.256886 Aug 02 10:55:11.603039 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 15/20] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:55:11 2022] GET /compute/v2.1/servers/b4dbc5ca-f31e-44e8-9573-6e79e891b989 => generated 1219 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:55:12.350537 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-e60bf8fe-fa52-42c3-8fa2-e175ffbfe79c tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Action: 'create', calling method: .version_select at 0x7f7c543333a0>, body: {"keypair": {"name": "tempest-keypair-836339730", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNpezYQpvZOG+jZSGlnYn5tIxaDzSH6hDWPghVzUWI73sf6IHoau1qy1NWxOhnakcdbWNCY4LKS6rjS2oT32feoEoS2jXJV+KE9PJTi+6kom/L4ziddP3GlVYhdcb9QM9Q=="}} {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:55:12.375233 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.quota [None req-e60bf8fe-fa52-42c3-8fa2-e175ffbfe79c tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Getting quotas for project 1b3a294d5d02485980c82f065ee76bd7. Resources: {'key_pairs'} {{(pid=129952) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 10:55:12.380271 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.quota [None req-e60bf8fe-fa52-42c3-8fa2-e175ffbfe79c tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Getting quotas for user ab1211acdd9a4df48c46f8807ed00063 and project 1b3a294d5d02485980c82f065ee76bd7. Resources: {'key_pairs'} {{(pid=129952) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 10:55:12.412650 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-84198a20-f0e7-4795-93b9-34e3a3968b01 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Action: 'create', calling method: .version_select at 0x7f7c54381b80>, body: {"keypair": {"name": "tempest-keypair-932821761", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzuNKvxHqksB6503EEGhKy1DI8d3vCCm/8uQWJuTNHfA4N2GIJkF5esJtgjI5AKBWavtqUWrVMuGW8mklY/gScbvmYkT4gpgCI+EHlBzGnS4w3zIsbhD3tm7eaCT3Halw=="}} {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:55:12.460414 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.quota [None req-84198a20-f0e7-4795-93b9-34e3a3968b01 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Getting quotas for project 302e92110a1545f1b84644b8971bb6eb. Resources: {'key_pairs'} {{(pid=129953) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 10:55:12.472458 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.quota [None req-84198a20-f0e7-4795-93b9-34e3a3968b01 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Getting quotas for user f3f41f17f5154e01a699043edc350cf8 and project 302e92110a1545f1b84644b8971bb6eb. Resources: {'key_pairs'} {{(pid=129953) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 10:55:12.540033 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-e60bf8fe-fa52-42c3-8fa2-e175ffbfe79c tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.938010 Aug 02 10:55:12.540587 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 6/21] 10.222.0.115 () {62 vars in 1205 bytes} [Tue Aug 2 10:55:11 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 939 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 02 10:55:12.599367 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-84198a20-f0e7-4795-93b9-34e3a3968b01 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] 10.222.0.115 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.860338 Aug 02 10:55:12.599978 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 16/22] 10.222.0.115 () {60 vars in 1164 bytes} [Tue Aug 2 10:55:11 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:55:12.612605 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-92a96c03-3ce4-46dd-aa8c-1b1592e78db6 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:12.613296 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-92a96c03-3ce4-46dd-aa8c-1b1592e78db6 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] [instance: b4dbc5ca-f31e-44e8-9573-6e79e891b989] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:12.771704 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-92a96c03-3ce4-46dd-aa8c-1b1592e78db6 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822e6ac5ec8347c9815c770738509d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ced4a8a26d94c10b08bbca381d62d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:12.801527 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-92a96c03-3ce4-46dd-aa8c-1b1592e78db6 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] 10.222.0.115 "GET /compute/v2.1/servers/b4dbc5ca-f31e-44e8-9573-6e79e891b989" status: 200 len: 1219 microversion: 2.1 time: 0.192205 Aug 02 10:55:12.803619 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 7/23] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:55:12 2022] GET /compute/v2.1/servers/b4dbc5ca-f31e-44e8-9573-6e79e891b989 => generated 1219 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:55:13.713693 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-ff3bd88e-165b-4bb0-99a7-239152437b76 tempest-VolumesTestJSON-1075129769 tempest-VolumesTestJSON-1075129769-project] Calling method '.version_select at 0x7f7c5434d820>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:13.825655 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-fb10bb2b-5805-47a6-a5f3-61fc478fd325 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:13.826282 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-fb10bb2b-5805-47a6-a5f3-61fc478fd325 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] [instance: b4dbc5ca-f31e-44e8-9573-6e79e891b989] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:13.858704 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-ff3bd88e-165b-4bb0-99a7-239152437b76 tempest-VolumesTestJSON-1075129769 tempest-VolumesTestJSON-1075129769-project] 10.222.0.115 "GET /compute/v2.1/os-volumes/63618eae-f389-40bd-8d6a-8b86076dea6d" status: 200 len: 350 microversion: 2.1 time: 0.196850 Aug 02 10:55:13.858704 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 17/24] 10.222.0.115 () {58 vars in 1250 bytes} [Tue Aug 2 10:55:13 2022] GET /compute/v2.1/os-volumes/63618eae-f389-40bd-8d6a-8b86076dea6d => generated 350 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:55:13.866611 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-0d07bdd7-2b3b-4462-90b4-4d4fa21617b3 tempest-VolumesTestJSON-1075129769 tempest-VolumesTestJSON-1075129769-project] Calling method '.version_select at 0x7f7c5434de50>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:14.004280 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-fb10bb2b-5805-47a6-a5f3-61fc478fd325 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822e6ac5ec8347c9815c770738509d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ced4a8a26d94c10b08bbca381d62d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:14.019261 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-fb10bb2b-5805-47a6-a5f3-61fc478fd325 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] 10.222.0.115 "GET /compute/v2.1/servers/b4dbc5ca-f31e-44e8-9573-6e79e891b989" status: 200 len: 1219 microversion: 2.1 time: 0.197800 Aug 02 10:55:14.028606 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 8/25] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:55:13 2022] GET /compute/v2.1/servers/b4dbc5ca-f31e-44e8-9573-6e79e891b989 => generated 1219 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:55:14.220099 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-0d07bdd7-2b3b-4462-90b4-4d4fa21617b3 tempest-VolumesTestJSON-1075129769 tempest-VolumesTestJSON-1075129769-project] 10.222.0.115 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.360085 Aug 02 10:55:14.228189 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 18/26] 10.222.0.115 () {58 vars in 1139 bytes} [Tue Aug 2 10:55:13 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:55:14.236831 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-4486ea10-f3f4-4231-83a9-d9b0335ef963 tempest-VolumesTestJSON-1075129769 tempest-VolumesTestJSON-1075129769-project] Calling method '.version_select at 0x7f7c542fc820>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:14.569174 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-4486ea10-f3f4-4231-83a9-d9b0335ef963 tempest-VolumesTestJSON-1075129769 tempest-VolumesTestJSON-1075129769-project] 10.222.0.115 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.336810 Aug 02 10:55:14.569760 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 9/27] 10.222.0.115 () {58 vars in 1154 bytes} [Tue Aug 2 10:55:14 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:55:14.586600 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-ec549544-27f0-4bc9-809b-ee8e9a872352 tempest-VolumesTestJSON-1075129769 tempest-VolumesTestJSON-1075129769-project] Calling method '.version_select at 0x7f7c54349d30>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:15.026475 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-ec549544-27f0-4bc9-809b-ee8e9a872352 tempest-VolumesTestJSON-1075129769 tempest-VolumesTestJSON-1075129769-project] 10.222.0.115 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.446453 Aug 02 10:55:15.043226 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 19/28] 10.222.0.115 () {58 vars in 1139 bytes} [Tue Aug 2 10:55:14 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:55:15.050613 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-20ac51b0-ab21-4177-9b33-e3d426e6cbda tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:15.051288 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-20ac51b0-ab21-4177-9b33-e3d426e6cbda tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] [instance: b4dbc5ca-f31e-44e8-9573-6e79e891b989] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:15.054130 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-ea2bc744-2369-4ae9-84a1-cd8e41fc16ac tempest-VolumesTestJSON-1075129769 tempest-VolumesTestJSON-1075129769-project] Calling method '.version_select at 0x7f7c54beb0d0>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:15.081539 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-20ac51b0-ab21-4177-9b33-e3d426e6cbda tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:15.082304 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-20ac51b0-ab21-4177-9b33-e3d426e6cbda tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:15.083452 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-20ac51b0-ab21-4177-9b33-e3d426e6cbda tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:15.086489 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-20ac51b0-ab21-4177-9b33-e3d426e6cbda tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:15.421776 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-ea2bc744-2369-4ae9-84a1-cd8e41fc16ac tempest-VolumesTestJSON-1075129769 tempest-VolumesTestJSON-1075129769-project] 10.222.0.115 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.377160 Aug 02 10:55:15.423092 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 20/29] 10.222.0.115 () {58 vars in 1172 bytes} [Tue Aug 2 10:55:15 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:55:15.438059 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-f117a5cf-8a12-4076-9300-f0a0c0b16071 tempest-VolumesTestJSON-1075129769 tempest-VolumesTestJSON-1075129769-project] Calling method '.version_select at 0x7f7c54341a60>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:15.490956 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-20ac51b0-ab21-4177-9b33-e3d426e6cbda tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822e6ac5ec8347c9815c770738509d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ced4a8a26d94c10b08bbca381d62d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:15.566737 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-20ac51b0-ab21-4177-9b33-e3d426e6cbda tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] 10.222.0.115 "GET /compute/v2.1/servers/b4dbc5ca-f31e-44e8-9573-6e79e891b989" status: 200 len: 1223 microversion: 2.1 time: 0.516881 Aug 02 10:55:15.583809 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 10/30] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:55:15 2022] GET /compute/v2.1/servers/b4dbc5ca-f31e-44e8-9573-6e79e891b989 => generated 1223 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:55:15.755599 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-2fb3ba38-a376-4714-868b-2351c3457e9c tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1279664272", "imageRef": "aa0a7b8c-0dd6-4803-8767-cb8c2d05fdd4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "aafffa4e-4cec-4281-b3a0-ebe26470b35c"}], "security_groups": [{"name": "tempest-securitygroup--1825755635"}], "key_name": "tempest-keypair-955711744", "user_data": "}} {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:55:15.755768 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-f117a5cf-8a12-4076-9300-f0a0c0b16071 tempest-VolumesTestJSON-1075129769 tempest-VolumesTestJSON-1075129769-project] 10.222.0.115 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.320635 Aug 02 10:55:15.756254 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 21/31] 10.222.0.115 () {58 vars in 1175 bytes} [Tue Aug 2 10:55:15 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:55:15.778620 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-17ab028f-3528-49a6-9058-b7ea16790ba6 tempest-VolumesTestJSON-1075129769 tempest-VolumesTestJSON-1075129769-project] Calling method '.version_select at 0x7f7c54349e50>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:15.903920 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-17ab028f-3528-49a6-9058-b7ea16790ba6 tempest-VolumesTestJSON-1075129769 tempest-VolumesTestJSON-1075129769-project] 10.222.0.115 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.130787 Aug 02 10:55:15.905261 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 22/32] 10.222.0.115 () {58 vars in 1160 bytes} [Tue Aug 2 10:55:15 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:55:15.919616 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-b37358ef-6f86-4309-944f-e2d3e93cb575 tempest-VolumesTestJSON-1075129769 tempest-VolumesTestJSON-1075129769-project] Calling method '.version_select at 0x7f7c543594c0>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:15.995795 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.network.neutron [None req-2fb3ba38-a376-4714-868b-2351c3457e9c tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] validate_networks() for [('aafffa4e-4cec-4281-b3a0-ebe26470b35c', None, None, None, None, None)] {{(pid=129952) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 10:55:16.085314 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-b37358ef-6f86-4309-944f-e2d3e93cb575 tempest-VolumesTestJSON-1075129769 tempest-VolumesTestJSON-1075129769-project] 10.222.0.115 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.170197 Aug 02 10:55:16.085863 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 23/33] 10.222.0.115 () {58 vars in 1193 bytes} [Tue Aug 2 10:55:15 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:55:16.102482 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-6768fc8a-7c5c-43f5-bd3c-da0296337aad tempest-VolumesTestJSON-1075129769 tempest-VolumesTestJSON-1075129769-project] Calling method '.version_select at 0x7f7c54349940>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:16.289964 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-6768fc8a-7c5c-43f5-bd3c-da0296337aad tempest-VolumesTestJSON-1075129769 tempest-VolumesTestJSON-1075129769-project] 10.222.0.115 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.191601 Aug 02 10:55:16.290537 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 24/34] 10.222.0.115 () {58 vars in 1160 bytes} [Tue Aug 2 10:55:16 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:55:16.543546 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.virt.hardware [None req-2fb3ba38-a376-4714-868b-2351c3457e9c tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Flavor limits 0:0:0 {{(pid=129952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 10:55:16.544079 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.virt.hardware [None req-2fb3ba38-a376-4714-868b-2351c3457e9c tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Image limits 0:0:0 {{(pid=129952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 10:55:16.544421 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.virt.hardware [None req-2fb3ba38-a376-4714-868b-2351c3457e9c tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Flavor pref 0:0:0 {{(pid=129952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 10:55:16.544827 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.virt.hardware [None req-2fb3ba38-a376-4714-868b-2351c3457e9c tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Image pref 0:0:0 {{(pid=129952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 10:55:16.546213 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.virt.hardware [None req-2fb3ba38-a376-4714-868b-2351c3457e9c tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 10:55:16.587672 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-2fb3ba38-a376-4714-868b-2351c3457e9c tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:16.588552 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-2fb3ba38-a376-4714-868b-2351c3457e9c tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:16.590685 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-349b376f-af57-4dfb-99de-9f4f1d971042 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:16.591079 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-2fb3ba38-a376-4714-868b-2351c3457e9c tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:16.591413 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-349b376f-af57-4dfb-99de-9f4f1d971042 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] [instance: b4dbc5ca-f31e-44e8-9573-6e79e891b989] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:16.591774 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-2fb3ba38-a376-4714-868b-2351c3457e9c tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:16.606874 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-349b376f-af57-4dfb-99de-9f4f1d971042 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:16.609177 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-349b376f-af57-4dfb-99de-9f4f1d971042 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:16.610340 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-349b376f-af57-4dfb-99de-9f4f1d971042 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:16.610805 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-349b376f-af57-4dfb-99de-9f4f1d971042 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:16.664209 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.quota [None req-2fb3ba38-a376-4714-868b-2351c3457e9c tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Getting quotas for project 89a4a0cf1852449e8bfc59ddb5a902c1. Resources: {'instances', 'cores', 'ram'} {{(pid=129952) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 10:55:16.665890 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.quota [None req-2fb3ba38-a376-4714-868b-2351c3457e9c tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Getting quotas for user 53bc14ada1564911b2f0a698aef3f333 and project 89a4a0cf1852449e8bfc59ddb5a902c1. Resources: {'instances', 'cores', 'ram'} {{(pid=129952) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 10:55:16.687755 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-2fb3ba38-a376-4714-868b-2351c3457e9c tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Going to run 1 instances... {{(pid=129952) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 10:55:16.692879 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-2fb3ba38-a376-4714-868b-2351c3457e9c tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: 8a7b8f4c-0c11-406f-bed6-b4fd18e3c304] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aa0a7b8c-0dd6-4803-8767-cb8c2d05fdd4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129952) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 10:55:16.809838 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-2fb3ba38-a376-4714-868b-2351c3457e9c tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.069557 Aug 02 10:55:16.813601 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 11/35] 10.222.0.115 () {60 vars in 1152 bytes} [Tue Aug 2 10:55:15 2022] POST /compute/v2.1/servers => generated 404 bytes in 1073 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Aug 02 10:55:16.828651 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-d58299ff-b61c-4958-962a-67cf4161a404 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:16.841217 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-d58299ff-b61c-4958-962a-67cf4161a404 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: 8a7b8f4c-0c11-406f-bed6-b4fd18e3c304] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:16.853219 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-349b376f-af57-4dfb-99de-9f4f1d971042 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822e6ac5ec8347c9815c770738509d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ced4a8a26d94c10b08bbca381d62d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:16.876287 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-349b376f-af57-4dfb-99de-9f4f1d971042 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] 10.222.0.115 "GET /compute/v2.1/servers/b4dbc5ca-f31e-44e8-9573-6e79e891b989" status: 200 len: 1279 microversion: 2.1 time: 0.290919 Aug 02 10:55:16.879813 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 25/36] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:55:16 2022] GET /compute/v2.1/servers/b4dbc5ca-f31e-44e8-9573-6e79e891b989 => generated 1279 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:55:17.019578 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-d58299ff-b61c-4958-962a-67cf4161a404 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bc14ada1564911b2f0a698aef3f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a4a0cf1852449e8bfc59ddb5a902c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:17.032352 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-d58299ff-b61c-4958-962a-67cf4161a404 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "GET /compute/v2.1/servers/8a7b8f4c-0c11-406f-bed6-b4fd18e3c304" status: 200 len: 1245 microversion: 2.1 time: 0.213850 Aug 02 10:55:17.035037 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 12/37] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:55:16 2022] GET /compute/v2.1/servers/8a7b8f4c-0c11-406f-bed6-b4fd18e3c304 => generated 1245 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:55:17.905644 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-468b84a6-de83-472f-9aa4-eca6b846acd0 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:17.906396 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-468b84a6-de83-472f-9aa4-eca6b846acd0 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] [instance: b4dbc5ca-f31e-44e8-9573-6e79e891b989] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:17.917190 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-468b84a6-de83-472f-9aa4-eca6b846acd0 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:17.917992 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-468b84a6-de83-472f-9aa4-eca6b846acd0 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:17.921705 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-468b84a6-de83-472f-9aa4-eca6b846acd0 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:17.922299 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-468b84a6-de83-472f-9aa4-eca6b846acd0 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:18.055840 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-468b84a6-de83-472f-9aa4-eca6b846acd0 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822e6ac5ec8347c9815c770738509d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ced4a8a26d94c10b08bbca381d62d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:18.056079 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-8caa38e4-48ae-4a18-b2f7-d80235d64184 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:18.056707 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-8caa38e4-48ae-4a18-b2f7-d80235d64184 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: 8a7b8f4c-0c11-406f-bed6-b4fd18e3c304] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:18.070219 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-468b84a6-de83-472f-9aa4-eca6b846acd0 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] 10.222.0.115 "GET /compute/v2.1/servers/b4dbc5ca-f31e-44e8-9573-6e79e891b989" status: 200 len: 1277 microversion: 2.1 time: 0.164673 Aug 02 10:55:18.070982 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 26/38] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:55:17 2022] GET /compute/v2.1/servers/b4dbc5ca-f31e-44e8-9573-6e79e891b989 => generated 1277 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:55:18.246680 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-8caa38e4-48ae-4a18-b2f7-d80235d64184 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bc14ada1564911b2f0a698aef3f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a4a0cf1852449e8bfc59ddb5a902c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:18.256926 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-8caa38e4-48ae-4a18-b2f7-d80235d64184 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "GET /compute/v2.1/servers/8a7b8f4c-0c11-406f-bed6-b4fd18e3c304" status: 200 len: 1245 microversion: 2.1 time: 0.204520 Aug 02 10:55:18.272128 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 13/39] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:55:18 2022] GET /compute/v2.1/servers/8a7b8f4c-0c11-406f-bed6-b4fd18e3c304 => generated 1245 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:55:19.115891 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-44923224-fbae-40b1-84a9-999949c5ae71 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:19.115891 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-44923224-fbae-40b1-84a9-999949c5ae71 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] [instance: b4dbc5ca-f31e-44e8-9573-6e79e891b989] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:19.121917 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-e77a1c66-17eb-43ad-a614-cdad1a378157 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-413418051", "imageRef": "aa0a7b8c-0dd6-4803-8767-cb8c2d05fdd4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6fe1227a-df5a-435e-ae6a-6d39b8b26123"}], "security_groups": [{"name": "tempest-securitygroup--190156432"}], "key_name": "tempest-keypair-932821761", "user_data": "}} {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:55:19.145894 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-44923224-fbae-40b1-84a9-999949c5ae71 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:19.152127 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-44923224-fbae-40b1-84a9-999949c5ae71 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:19.157011 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-44923224-fbae-40b1-84a9-999949c5ae71 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:19.159168 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-44923224-fbae-40b1-84a9-999949c5ae71 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:19.617480 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.network.neutron [None req-e77a1c66-17eb-43ad-a614-cdad1a378157 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] validate_networks() for [('6fe1227a-df5a-435e-ae6a-6d39b8b26123', None, None, None, None, None)] {{(pid=129952) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 10:55:19.626207 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-44923224-fbae-40b1-84a9-999949c5ae71 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822e6ac5ec8347c9815c770738509d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ced4a8a26d94c10b08bbca381d62d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:19.644826 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-44923224-fbae-40b1-84a9-999949c5ae71 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] 10.222.0.115 "GET /compute/v2.1/servers/b4dbc5ca-f31e-44e8-9573-6e79e891b989" status: 200 len: 1319 microversion: 2.1 time: 0.553718 Aug 02 10:55:19.652903 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 27/40] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:55:19 2022] GET /compute/v2.1/servers/b4dbc5ca-f31e-44e8-9573-6e79e891b989 => generated 1319 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:55:19.691795 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-5a97d2c4-153d-4aa5-8c80-a7ca73c3c3ce tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:19.693802 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-5a97d2c4-153d-4aa5-8c80-a7ca73c3c3ce tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: 8a7b8f4c-0c11-406f-bed6-b4fd18e3c304] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:19.707405 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-5a97d2c4-153d-4aa5-8c80-a7ca73c3c3ce tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:19.712263 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-5a97d2c4-153d-4aa5-8c80-a7ca73c3c3ce tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:19.713359 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-5a97d2c4-153d-4aa5-8c80-a7ca73c3c3ce tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:19.714009 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-5a97d2c4-153d-4aa5-8c80-a7ca73c3c3ce tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:19.885054 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-5a97d2c4-153d-4aa5-8c80-a7ca73c3c3ce tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bc14ada1564911b2f0a698aef3f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a4a0cf1852449e8bfc59ddb5a902c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:19.896920 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-5a97d2c4-153d-4aa5-8c80-a7ca73c3c3ce tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "GET /compute/v2.1/servers/8a7b8f4c-0c11-406f-bed6-b4fd18e3c304" status: 200 len: 1249 microversion: 2.1 time: 0.241043 Aug 02 10:55:19.912503 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 28/41] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:55:19 2022] GET /compute/v2.1/servers/8a7b8f4c-0c11-406f-bed6-b4fd18e3c304 => generated 1249 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:55:19.921618 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-cbc00464-d2ac-4891-89b3-2b325d86d278 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-676836529", "imageRef": "aa0a7b8c-0dd6-4803-8767-cb8c2d05fdd4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7da1785e-f1d0-42a6-a98f-5f5946ede1eb"}], "security_groups": [{"name": "tempest-securitygroup--1604222008"}], "key_name": "tempest-keypair-836339730", "user_data": "}} {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:55:20.484826 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.network.neutron [None req-cbc00464-d2ac-4891-89b3-2b325d86d278 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] validate_networks() for [('7da1785e-f1d0-42a6-a98f-5f5946ede1eb', None, None, None, None, None)] {{(pid=129953) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 10:55:21.209752 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.virt.hardware [None req-e77a1c66-17eb-43ad-a614-cdad1a378157 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Flavor limits 0:0:0 {{(pid=129952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 10:55:21.214256 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.virt.hardware [None req-e77a1c66-17eb-43ad-a614-cdad1a378157 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Image limits 0:0:0 {{(pid=129952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 10:55:21.214256 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.virt.hardware [None req-e77a1c66-17eb-43ad-a614-cdad1a378157 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Flavor pref 0:0:0 {{(pid=129952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 10:55:21.214256 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.virt.hardware [None req-e77a1c66-17eb-43ad-a614-cdad1a378157 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Image pref 0:0:0 {{(pid=129952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 10:55:21.214749 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.virt.hardware [None req-e77a1c66-17eb-43ad-a614-cdad1a378157 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 10:55:21.236341 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-e77a1c66-17eb-43ad-a614-cdad1a378157 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:21.240857 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-e77a1c66-17eb-43ad-a614-cdad1a378157 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:21.240857 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-e77a1c66-17eb-43ad-a614-cdad1a378157 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:21.240857 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-e77a1c66-17eb-43ad-a614-cdad1a378157 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:21.275866 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.quota [None req-e77a1c66-17eb-43ad-a614-cdad1a378157 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Getting quotas for project 302e92110a1545f1b84644b8971bb6eb. Resources: {'instances', 'cores', 'ram'} {{(pid=129952) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 10:55:21.283557 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.quota [None req-e77a1c66-17eb-43ad-a614-cdad1a378157 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Getting quotas for user f3f41f17f5154e01a699043edc350cf8 and project 302e92110a1545f1b84644b8971bb6eb. Resources: {'instances', 'cores', 'ram'} {{(pid=129952) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 10:55:21.303894 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-e77a1c66-17eb-43ad-a614-cdad1a378157 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Going to run 1 instances... {{(pid=129952) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 10:55:21.303894 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-e77a1c66-17eb-43ad-a614-cdad1a378157 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] [instance: 3938932a-e778-4c0c-9ab0-78dc9082a48e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aa0a7b8c-0dd6-4803-8767-cb8c2d05fdd4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129952) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 10:55:21.448286 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-e77a1c66-17eb-43ad-a614-cdad1a378157 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] 10.222.0.115 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 2.331603 Aug 02 10:55:21.449170 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 14/42] 10.222.0.115 () {60 vars in 1152 bytes} [Tue Aug 2 10:55:19 2022] POST /compute/v2.1/servers => generated 403 bytes in 2336 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Aug 02 10:55:21.470440 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-3d5ea22e-9353-4b49-b98b-dd766e881dbe tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:21.470440 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-3d5ea22e-9353-4b49-b98b-dd766e881dbe tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] [instance: b4dbc5ca-f31e-44e8-9573-6e79e891b989] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:21.479032 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-3d5ea22e-9353-4b49-b98b-dd766e881dbe tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:21.479868 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-3d5ea22e-9353-4b49-b98b-dd766e881dbe tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:21.480859 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-3d5ea22e-9353-4b49-b98b-dd766e881dbe tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:21.482292 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-3d5ea22e-9353-4b49-b98b-dd766e881dbe tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:22.488760 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG dbcounter [-] [129953] Writing DB stats nova_cell0:SELECT=10 {{(pid=129953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:55:22.708316 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-3d5ea22e-9353-4b49-b98b-dd766e881dbe tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822e6ac5ec8347c9815c770738509d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ced4a8a26d94c10b08bbca381d62d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:22.752571 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-3d5ea22e-9353-4b49-b98b-dd766e881dbe tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] 10.222.0.115 "GET /compute/v2.1/servers/b4dbc5ca-f31e-44e8-9573-6e79e891b989" status: 200 len: 1319 microversion: 2.1 time: 1.300903 Aug 02 10:55:22.762064 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 15/43] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:55:21 2022] GET /compute/v2.1/servers/b4dbc5ca-f31e-44e8-9573-6e79e891b989 => generated 1319 bytes in 1312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:55:22.768529 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-11640dc3-c0ad-4230-9825-08053d640057 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:22.773366 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-11640dc3-c0ad-4230-9825-08053d640057 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: 8a7b8f4c-0c11-406f-bed6-b4fd18e3c304] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:22.796787 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-11640dc3-c0ad-4230-9825-08053d640057 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:22.799620 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-11640dc3-c0ad-4230-9825-08053d640057 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:22.800704 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-11640dc3-c0ad-4230-9825-08053d640057 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:22.801299 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-11640dc3-c0ad-4230-9825-08053d640057 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:22.852497 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.virt.hardware [None req-cbc00464-d2ac-4891-89b3-2b325d86d278 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Flavor limits 0:0:0 {{(pid=129953) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 10:55:22.853128 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.virt.hardware [None req-cbc00464-d2ac-4891-89b3-2b325d86d278 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Image limits 0:0:0 {{(pid=129953) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 10:55:22.853769 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.virt.hardware [None req-cbc00464-d2ac-4891-89b3-2b325d86d278 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Flavor pref 0:0:0 {{(pid=129953) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 10:55:22.854398 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.virt.hardware [None req-cbc00464-d2ac-4891-89b3-2b325d86d278 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Image pref 0:0:0 {{(pid=129953) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 10:55:22.855066 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.virt.hardware [None req-cbc00464-d2ac-4891-89b3-2b325d86d278 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129953) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 10:55:22.891433 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-cbc00464-d2ac-4891-89b3-2b325d86d278 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:22.897018 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-cbc00464-d2ac-4891-89b3-2b325d86d278 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:22.898351 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-cbc00464-d2ac-4891-89b3-2b325d86d278 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:22.900462 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-cbc00464-d2ac-4891-89b3-2b325d86d278 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:22.980394 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.quota [None req-cbc00464-d2ac-4891-89b3-2b325d86d278 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Getting quotas for project 1b3a294d5d02485980c82f065ee76bd7. Resources: {'instances', 'cores', 'ram'} {{(pid=129953) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 10:55:22.987027 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.quota [None req-cbc00464-d2ac-4891-89b3-2b325d86d278 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Getting quotas for user ab1211acdd9a4df48c46f8807ed00063 and project 1b3a294d5d02485980c82f065ee76bd7. Resources: {'instances', 'cores', 'ram'} {{(pid=129953) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 10:55:23.004815 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-cbc00464-d2ac-4891-89b3-2b325d86d278 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Going to run 1 instances... {{(pid=129953) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 10:55:23.008571 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-cbc00464-d2ac-4891-89b3-2b325d86d278 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: b3a92fc5-5c44-48d1-8394-535687bb6ae3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aa0a7b8c-0dd6-4803-8767-cb8c2d05fdd4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129953) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 10:55:23.019529 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-11640dc3-c0ad-4230-9825-08053d640057 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bc14ada1564911b2f0a698aef3f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a4a0cf1852449e8bfc59ddb5a902c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:23.038298 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-11640dc3-c0ad-4230-9825-08053d640057 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "GET /compute/v2.1/servers/8a7b8f4c-0c11-406f-bed6-b4fd18e3c304" status: 200 len: 1303 microversion: 2.1 time: 0.275070 Aug 02 10:55:23.044292 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 16/44] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:55:22 2022] GET /compute/v2.1/servers/8a7b8f4c-0c11-406f-bed6-b4fd18e3c304 => generated 1303 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:55:23.058548 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-2f2b2186-0c7d-4b3d-961b-249589c8296c tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:23.058548 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-2f2b2186-0c7d-4b3d-961b-249589c8296c tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] [instance: 3938932a-e778-4c0c-9ab0-78dc9082a48e] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:23.171918 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-2f2b2186-0c7d-4b3d-961b-249589c8296c tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f41f17f5154e01a699043edc350cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e92110a1545f1b84644b8971bb6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:23.180144 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-2f2b2186-0c7d-4b3d-961b-249589c8296c tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] 10.222.0.115 "GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e" status: 200 len: 1240 microversion: 2.1 time: 0.134048 Aug 02 10:55:23.181355 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 17/45] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:55:23 2022] GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e => generated 1240 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:55:23.315187 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-cbc00464-d2ac-4891-89b3-2b325d86d278 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.20 time: 3.400806 Aug 02 10:55:23.316398 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 29/46] 10.222.0.115 () {62 vars in 1193 bytes} [Tue Aug 2 10:55:19 2022] POST /compute/v2.1/servers => generated 404 bytes in 3403 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 02 10:55:23.330199 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-ac8e3c0a-d716-4fc0-b82c-1ba0e96e194c tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:23.330814 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-ac8e3c0a-d716-4fc0-b82c-1ba0e96e194c tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: b3a92fc5-5c44-48d1-8394-535687bb6ae3] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:23.599377 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-ac8e3c0a-d716-4fc0-b82c-1ba0e96e194c tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:23.613911 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-ac8e3c0a-d716-4fc0-b82c-1ba0e96e194c tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:23.630223 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-ac8e3c0a-d716-4fc0-b82c-1ba0e96e194c tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:23.631402 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-ac8e3c0a-d716-4fc0-b82c-1ba0e96e194c tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3" status: 200 len: 1284 microversion: 2.20 time: 0.306736 Aug 02 10:55:23.632189 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 18/47] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 10:55:23 2022] GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3 => generated 1284 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:55:23.729791 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [req-da5507b4-bade-4a1b-abba-07047eb17519 req-39b66f58-7100-441a-b5c7-2957ef89649c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4dbc5ca-f31e-44e8-9573-6e79e891b989", "tag": "86f8bd72-e159-4310-b36a-1444e34459c4"}]} {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:55:23.757192 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [req-da5507b4-bade-4a1b-abba-07047eb17519 req-39b66f58-7100-441a-b5c7-2957ef89649c service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:23.763209 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [req-da5507b4-bade-4a1b-abba-07047eb17519 req-39b66f58-7100-441a-b5c7-2957ef89649c service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:23.785873 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-3adb5d50-e0d5-44aa-9469-d1af5d4f7243 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:23.789175 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-3adb5d50-e0d5-44aa-9469-d1af5d4f7243 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] [instance: b4dbc5ca-f31e-44e8-9573-6e79e891b989] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:23.820056 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-3adb5d50-e0d5-44aa-9469-d1af5d4f7243 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:23.820410 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-3adb5d50-e0d5-44aa-9469-d1af5d4f7243 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:23.821872 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-3adb5d50-e0d5-44aa-9469-d1af5d4f7243 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:23.822462 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-3adb5d50-e0d5-44aa-9469-d1af5d4f7243 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:23.825189 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.compute.server_external_events [req-da5507b4-bade-4a1b-abba-07047eb17519 req-39b66f58-7100-441a-b5c7-2957ef89649c service nova] Creating event network-changed:86f8bd72-e159-4310-b36a-1444e34459c4 for instance b4dbc5ca-f31e-44e8-9573-6e79e891b989 on hv-cinder-85031 Aug 02 10:55:23.826456 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [req-da5507b4-bade-4a1b-abba-07047eb17519 req-39b66f58-7100-441a-b5c7-2957ef89649c service nova] Acquired lock "compute-rpcapi-router" {{(pid=129953) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 02 10:55:23.827730 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-94e16d35-9d38-4f5a-9d3a-9585234d47ab None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:23.828201 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-94e16d35-9d38-4f5a-9d3a-9585234d47ab None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:23.829184 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-94e16d35-9d38-4f5a-9d3a-9585234d47ab None None] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:23.829628 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-94e16d35-9d38-4f5a-9d3a-9585234d47ab None None] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:23.869352 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.compute.rpcapi [None req-94e16d35-9d38-4f5a-9d3a-9585234d47ab None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 02 10:55:23.870612 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-94e16d35-9d38-4f5a-9d3a-9585234d47ab None None] Releasing lock "compute-rpcapi-router" {{(pid=129953) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 02 10:55:23.902431 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-94e16d35-9d38-4f5a-9d3a-9585234d47ab None None] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.296150 Aug 02 10:55:23.906106 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 30/48] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Aug 2 10:55:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:55:24.079187 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-120b2221-a973-41df-b235-fc9c0423c5f4 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:24.080719 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-120b2221-a973-41df-b235-fc9c0423c5f4 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: 8a7b8f4c-0c11-406f-bed6-b4fd18e3c304] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:24.097747 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-120b2221-a973-41df-b235-fc9c0423c5f4 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:24.099725 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-120b2221-a973-41df-b235-fc9c0423c5f4 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:24.100604 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-120b2221-a973-41df-b235-fc9c0423c5f4 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:24.101728 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-120b2221-a973-41df-b235-fc9c0423c5f4 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:24.251076 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-120b2221-a973-41df-b235-fc9c0423c5f4 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bc14ada1564911b2f0a698aef3f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a4a0cf1852449e8bfc59ddb5a902c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:24.252297 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-3adb5d50-e0d5-44aa-9469-d1af5d4f7243 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822e6ac5ec8347c9815c770738509d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ced4a8a26d94c10b08bbca381d62d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:24.265608 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-120b2221-a973-41df-b235-fc9c0423c5f4 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "GET /compute/v2.1/servers/8a7b8f4c-0c11-406f-bed6-b4fd18e3c304" status: 200 len: 1303 microversion: 2.1 time: 0.200713 Aug 02 10:55:24.270543 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-3adb5d50-e0d5-44aa-9469-d1af5d4f7243 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] 10.222.0.115 "GET /compute/v2.1/servers/b4dbc5ca-f31e-44e8-9573-6e79e891b989" status: 200 len: 1319 microversion: 2.1 time: 0.485998 Aug 02 10:55:24.292575 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 31/49] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:55:24 2022] GET /compute/v2.1/servers/8a7b8f4c-0c11-406f-bed6-b4fd18e3c304 => generated 1303 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:55:24.293827 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 19/50] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:55:23 2022] GET /compute/v2.1/servers/b4dbc5ca-f31e-44e8-9573-6e79e891b989 => generated 1319 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:55:24.315515 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-4e82f4bd-2939-44ac-9881-832864544d57 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:24.319692 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-4e82f4bd-2939-44ac-9881-832864544d57 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] [instance: 3938932a-e778-4c0c-9ab0-78dc9082a48e] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:24.344379 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-4e82f4bd-2939-44ac-9881-832864544d57 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:24.347132 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-4e82f4bd-2939-44ac-9881-832864544d57 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:24.357942 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-4e82f4bd-2939-44ac-9881-832864544d57 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:24.357942 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-4e82f4bd-2939-44ac-9881-832864544d57 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:24.614559 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-4e82f4bd-2939-44ac-9881-832864544d57 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f41f17f5154e01a699043edc350cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e92110a1545f1b84644b8971bb6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:24.626602 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-4e82f4bd-2939-44ac-9881-832864544d57 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] 10.222.0.115 "GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e" status: 200 len: 1244 microversion: 2.1 time: 0.327985 Aug 02 10:55:24.649351 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 32/51] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:55:24 2022] GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e => generated 1244 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:55:24.663215 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-86dfd7f2-1ec3-4b51-a441-0f178369b4f5 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:24.666908 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-86dfd7f2-1ec3-4b51-a441-0f178369b4f5 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: b3a92fc5-5c44-48d1-8394-535687bb6ae3] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:24.680424 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG dbcounter [-] [129952] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=129952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:55:24.803937 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-86dfd7f2-1ec3-4b51-a441-0f178369b4f5 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:24.814741 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-86dfd7f2-1ec3-4b51-a441-0f178369b4f5 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:24.818204 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-86dfd7f2-1ec3-4b51-a441-0f178369b4f5 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:24.818204 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-86dfd7f2-1ec3-4b51-a441-0f178369b4f5 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3" status: 200 len: 1284 microversion: 2.20 time: 0.160244 Aug 02 10:55:24.819380 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 20/52] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 10:55:24 2022] GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3 => generated 1284 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:55:25.301150 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-15667707-e016-488a-a9fc-f5bcb4cc1751 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:25.301777 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-16886c48-bc20-4d4b-ba69-2e2e5afaa4d2 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:25.302536 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-16886c48-bc20-4d4b-ba69-2e2e5afaa4d2 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: 8a7b8f4c-0c11-406f-bed6-b4fd18e3c304] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:25.309243 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-16886c48-bc20-4d4b-ba69-2e2e5afaa4d2 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:25.309701 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-16886c48-bc20-4d4b-ba69-2e2e5afaa4d2 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:25.311932 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-15667707-e016-488a-a9fc-f5bcb4cc1751 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] [instance: b4dbc5ca-f31e-44e8-9573-6e79e891b989] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:25.316511 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-16886c48-bc20-4d4b-ba69-2e2e5afaa4d2 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:25.316511 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-16886c48-bc20-4d4b-ba69-2e2e5afaa4d2 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:25.322827 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-15667707-e016-488a-a9fc-f5bcb4cc1751 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:25.322827 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-15667707-e016-488a-a9fc-f5bcb4cc1751 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:25.323588 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-15667707-e016-488a-a9fc-f5bcb4cc1751 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:25.323963 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-15667707-e016-488a-a9fc-f5bcb4cc1751 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:25.594919 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-15667707-e016-488a-a9fc-f5bcb4cc1751 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822e6ac5ec8347c9815c770738509d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ced4a8a26d94c10b08bbca381d62d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:25.610243 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-16886c48-bc20-4d4b-ba69-2e2e5afaa4d2 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bc14ada1564911b2f0a698aef3f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a4a0cf1852449e8bfc59ddb5a902c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:25.617118 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-15667707-e016-488a-a9fc-f5bcb4cc1751 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] 10.222.0.115 "GET /compute/v2.1/servers/b4dbc5ca-f31e-44e8-9573-6e79e891b989" status: 200 len: 1319 microversion: 2.1 time: 0.315778 Aug 02 10:55:25.634628 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 33/53] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:55:25 2022] GET /compute/v2.1/servers/b4dbc5ca-f31e-44e8-9573-6e79e891b989 => generated 1319 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:55:25.635174 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-16886c48-bc20-4d4b-ba69-2e2e5afaa4d2 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "GET /compute/v2.1/servers/8a7b8f4c-0c11-406f-bed6-b4fd18e3c304" status: 200 len: 1371 microversion: 2.1 time: 0.342088 Aug 02 10:55:25.637549 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 21/54] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:55:25 2022] GET /compute/v2.1/servers/8a7b8f4c-0c11-406f-bed6-b4fd18e3c304 => generated 1371 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:55:25.653177 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-fa797496-fc56-453c-9eef-d1987ce4af26 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:25.655109 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-fa797496-fc56-453c-9eef-d1987ce4af26 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] [instance: 3938932a-e778-4c0c-9ab0-78dc9082a48e] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:25.667907 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-fa797496-fc56-453c-9eef-d1987ce4af26 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:25.668399 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-fa797496-fc56-453c-9eef-d1987ce4af26 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:25.672122 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-fa797496-fc56-453c-9eef-d1987ce4af26 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:25.672122 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-fa797496-fc56-453c-9eef-d1987ce4af26 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:25.842877 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-475a8bb8-0863-4b01-841b-c9c65700c417 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:25.843709 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-475a8bb8-0863-4b01-841b-c9c65700c417 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: b3a92fc5-5c44-48d1-8394-535687bb6ae3] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:25.843835 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-fa797496-fc56-453c-9eef-d1987ce4af26 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f41f17f5154e01a699043edc350cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e92110a1545f1b84644b8971bb6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:25.858556 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-475a8bb8-0863-4b01-841b-c9c65700c417 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:25.859141 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-475a8bb8-0863-4b01-841b-c9c65700c417 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:25.860373 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-475a8bb8-0863-4b01-841b-c9c65700c417 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:25.861467 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-475a8bb8-0863-4b01-841b-c9c65700c417 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:25.868081 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-fa797496-fc56-453c-9eef-d1987ce4af26 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] 10.222.0.115 "GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e" status: 200 len: 1244 microversion: 2.1 time: 0.218777 Aug 02 10:55:25.884310 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 34/55] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:55:25 2022] GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e => generated 1244 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:55:25.977492 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-475a8bb8-0863-4b01-841b-c9c65700c417 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:25.987090 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-475a8bb8-0863-4b01-841b-c9c65700c417 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:25.989359 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-475a8bb8-0863-4b01-841b-c9c65700c417 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:25.990523 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-475a8bb8-0863-4b01-841b-c9c65700c417 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3" status: 200 len: 1288 microversion: 2.20 time: 0.153477 Aug 02 10:55:25.991661 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 22/56] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 10:55:25 2022] GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3 => generated 1288 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:55:26.638893 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-576b91c0-fb1d-4416-8188-bf7dd34e4727 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:26.641064 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-576b91c0-fb1d-4416-8188-bf7dd34e4727 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] [instance: b4dbc5ca-f31e-44e8-9573-6e79e891b989] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:26.649622 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-576b91c0-fb1d-4416-8188-bf7dd34e4727 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:26.650288 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-576b91c0-fb1d-4416-8188-bf7dd34e4727 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:26.651440 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-576b91c0-fb1d-4416-8188-bf7dd34e4727 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:26.652312 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-576b91c0-fb1d-4416-8188-bf7dd34e4727 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:26.665126 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-53427659-deb2-479a-a5da-bd6f7d9e5cd0 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:26.668176 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-53427659-deb2-479a-a5da-bd6f7d9e5cd0 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: 8a7b8f4c-0c11-406f-bed6-b4fd18e3c304] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:26.684460 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-53427659-deb2-479a-a5da-bd6f7d9e5cd0 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:26.685769 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-53427659-deb2-479a-a5da-bd6f7d9e5cd0 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:26.691483 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-53427659-deb2-479a-a5da-bd6f7d9e5cd0 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:26.691483 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-53427659-deb2-479a-a5da-bd6f7d9e5cd0 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:27.344823 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-53427659-deb2-479a-a5da-bd6f7d9e5cd0 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bc14ada1564911b2f0a698aef3f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a4a0cf1852449e8bfc59ddb5a902c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:27.368890 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-53427659-deb2-479a-a5da-bd6f7d9e5cd0 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "GET /compute/v2.1/servers/8a7b8f4c-0c11-406f-bed6-b4fd18e3c304" status: 200 len: 1371 microversion: 2.1 time: 0.711041 Aug 02 10:55:27.374166 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 23/57] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:55:26 2022] GET /compute/v2.1/servers/8a7b8f4c-0c11-406f-bed6-b4fd18e3c304 => generated 1371 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:55:27.396573 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-86edd516-06d7-46ef-8081-d956a0effd2d tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:27.408064 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-86edd516-06d7-46ef-8081-d956a0effd2d tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] [instance: 3938932a-e778-4c0c-9ab0-78dc9082a48e] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:27.429281 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-86edd516-06d7-46ef-8081-d956a0effd2d tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:27.434812 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-86edd516-06d7-46ef-8081-d956a0effd2d tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:27.441209 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-86edd516-06d7-46ef-8081-d956a0effd2d tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:27.443675 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-86edd516-06d7-46ef-8081-d956a0effd2d tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:27.496697 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-576b91c0-fb1d-4416-8188-bf7dd34e4727 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822e6ac5ec8347c9815c770738509d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ced4a8a26d94c10b08bbca381d62d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:27.506875 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-576b91c0-fb1d-4416-8188-bf7dd34e4727 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] 10.222.0.115 "GET /compute/v2.1/servers/b4dbc5ca-f31e-44e8-9573-6e79e891b989" status: 200 len: 1319 microversion: 2.1 time: 0.872527 Aug 02 10:55:27.519605 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 35/58] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:55:26 2022] GET /compute/v2.1/servers/b4dbc5ca-f31e-44e8-9573-6e79e891b989 => generated 1319 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:55:27.531002 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-e6170c38-e5d4-43a5-bd9c-50bc202314a2 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:27.531903 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-e6170c38-e5d4-43a5-bd9c-50bc202314a2 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: b3a92fc5-5c44-48d1-8394-535687bb6ae3] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:27.542533 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-e6170c38-e5d4-43a5-bd9c-50bc202314a2 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:27.543379 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-e6170c38-e5d4-43a5-bd9c-50bc202314a2 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:27.544373 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-e6170c38-e5d4-43a5-bd9c-50bc202314a2 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:27.545489 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-e6170c38-e5d4-43a5-bd9c-50bc202314a2 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:28.033089 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-e6170c38-e5d4-43a5-bd9c-50bc202314a2 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:28.051315 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-e6170c38-e5d4-43a5-bd9c-50bc202314a2 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:28.057067 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-e6170c38-e5d4-43a5-bd9c-50bc202314a2 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:28.058438 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-e6170c38-e5d4-43a5-bd9c-50bc202314a2 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3" status: 200 len: 1280 microversion: 2.20 time: 0.537345 Aug 02 10:55:28.076680 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 36/59] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 10:55:27 2022] GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3 => generated 1280 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:55:28.143378 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-86edd516-06d7-46ef-8081-d956a0effd2d tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f41f17f5154e01a699043edc350cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e92110a1545f1b84644b8971bb6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:28.153456 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-86edd516-06d7-46ef-8081-d956a0effd2d tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] 10.222.0.115 "GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e" status: 200 len: 1236 microversion: 2.1 time: 0.770987 Aug 02 10:55:28.168555 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 24/60] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:55:27 2022] GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e => generated 1236 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:55:28.398910 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-86b25ec6-c3fb-42e9-8f5c-64509af63908 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:28.399903 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-86b25ec6-c3fb-42e9-8f5c-64509af63908 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: 8a7b8f4c-0c11-406f-bed6-b4fd18e3c304] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:28.409071 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-86b25ec6-c3fb-42e9-8f5c-64509af63908 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:28.410039 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-86b25ec6-c3fb-42e9-8f5c-64509af63908 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:28.414035 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-86b25ec6-c3fb-42e9-8f5c-64509af63908 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:28.414035 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-86b25ec6-c3fb-42e9-8f5c-64509af63908 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:28.535582 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-b9069b92-b82a-45e9-a170-9ea7b97a5590 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:28.536286 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-b9069b92-b82a-45e9-a170-9ea7b97a5590 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] [instance: b4dbc5ca-f31e-44e8-9573-6e79e891b989] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:28.552620 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-b9069b92-b82a-45e9-a170-9ea7b97a5590 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:28.554529 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-b9069b92-b82a-45e9-a170-9ea7b97a5590 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:28.568505 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-b9069b92-b82a-45e9-a170-9ea7b97a5590 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:28.569791 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-b9069b92-b82a-45e9-a170-9ea7b97a5590 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:28.851888 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-86b25ec6-c3fb-42e9-8f5c-64509af63908 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bc14ada1564911b2f0a698aef3f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a4a0cf1852449e8bfc59ddb5a902c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:28.861108 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-86b25ec6-c3fb-42e9-8f5c-64509af63908 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "GET /compute/v2.1/servers/8a7b8f4c-0c11-406f-bed6-b4fd18e3c304" status: 200 len: 1371 microversion: 2.1 time: 0.466907 Aug 02 10:55:28.868185 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 37/61] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:55:28 2022] GET /compute/v2.1/servers/8a7b8f4c-0c11-406f-bed6-b4fd18e3c304 => generated 1371 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:55:29.088843 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-fa8a739c-de5d-4adc-9c78-1527a8c4fe31 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:29.091613 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-fa8a739c-de5d-4adc-9c78-1527a8c4fe31 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: b3a92fc5-5c44-48d1-8394-535687bb6ae3] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:29.106169 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-b9069b92-b82a-45e9-a170-9ea7b97a5590 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822e6ac5ec8347c9815c770738509d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ced4a8a26d94c10b08bbca381d62d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:29.108375 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-fa8a739c-de5d-4adc-9c78-1527a8c4fe31 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:29.109148 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-fa8a739c-de5d-4adc-9c78-1527a8c4fe31 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:29.110125 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-fa8a739c-de5d-4adc-9c78-1527a8c4fe31 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:29.110716 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-fa8a739c-de5d-4adc-9c78-1527a8c4fe31 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:29.126511 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-b9069b92-b82a-45e9-a170-9ea7b97a5590 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] 10.222.0.115 "GET /compute/v2.1/servers/b4dbc5ca-f31e-44e8-9573-6e79e891b989" status: 200 len: 1319 microversion: 2.1 time: 0.597872 Aug 02 10:55:29.127912 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 25/62] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:55:28 2022] GET /compute/v2.1/servers/b4dbc5ca-f31e-44e8-9573-6e79e891b989 => generated 1319 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:55:29.187535 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-814bce6c-816a-464d-8b15-164f14c05912 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:29.189979 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-814bce6c-816a-464d-8b15-164f14c05912 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] [instance: 3938932a-e778-4c0c-9ab0-78dc9082a48e] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:29.208718 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-814bce6c-816a-464d-8b15-164f14c05912 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:29.209087 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-814bce6c-816a-464d-8b15-164f14c05912 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:29.209860 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-814bce6c-816a-464d-8b15-164f14c05912 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:29.210288 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-814bce6c-816a-464d-8b15-164f14c05912 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:29.401982 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-fa8a739c-de5d-4adc-9c78-1527a8c4fe31 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:29.427006 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-fa8a739c-de5d-4adc-9c78-1527a8c4fe31 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:29.428853 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-fa8a739c-de5d-4adc-9c78-1527a8c4fe31 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:29.445390 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-fa8a739c-de5d-4adc-9c78-1527a8c4fe31 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3" status: 200 len: 1344 microversion: 2.20 time: 0.346966 Aug 02 10:55:29.451245 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 38/63] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 10:55:29 2022] GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3 => generated 1344 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:55:29.579810 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-814bce6c-816a-464d-8b15-164f14c05912 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f41f17f5154e01a699043edc350cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e92110a1545f1b84644b8971bb6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:29.589853 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-814bce6c-816a-464d-8b15-164f14c05912 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] 10.222.0.115 "GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e" status: 200 len: 1310 microversion: 2.1 time: 0.411299 Aug 02 10:55:29.590401 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 26/64] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:55:29 2022] GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e => generated 1310 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:55:29.893630 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-d11eee92-7b1b-46d4-8a65-6d50f6bc5ca6 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:29.894258 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-d11eee92-7b1b-46d4-8a65-6d50f6bc5ca6 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: 8a7b8f4c-0c11-406f-bed6-b4fd18e3c304] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:29.915037 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-d11eee92-7b1b-46d4-8a65-6d50f6bc5ca6 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:29.915889 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-d11eee92-7b1b-46d4-8a65-6d50f6bc5ca6 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:29.916300 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-d11eee92-7b1b-46d4-8a65-6d50f6bc5ca6 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:29.930102 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-d11eee92-7b1b-46d4-8a65-6d50f6bc5ca6 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:30.151681 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-16765907-8573-46a1-ba36-d33fc269ac4b tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:30.152299 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-16765907-8573-46a1-ba36-d33fc269ac4b tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] [instance: b4dbc5ca-f31e-44e8-9573-6e79e891b989] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:30.175676 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-16765907-8573-46a1-ba36-d33fc269ac4b tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:30.176534 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-16765907-8573-46a1-ba36-d33fc269ac4b tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:30.177565 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-16765907-8573-46a1-ba36-d33fc269ac4b tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:30.178750 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-16765907-8573-46a1-ba36-d33fc269ac4b tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:30.556087 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-d11eee92-7b1b-46d4-8a65-6d50f6bc5ca6 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bc14ada1564911b2f0a698aef3f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a4a0cf1852449e8bfc59ddb5a902c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:30.577806 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-d11eee92-7b1b-46d4-8a65-6d50f6bc5ca6 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "GET /compute/v2.1/servers/8a7b8f4c-0c11-406f-bed6-b4fd18e3c304" status: 200 len: 1371 microversion: 2.1 time: 0.688383 Aug 02 10:55:30.579379 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 39/65] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:55:29 2022] GET /compute/v2.1/servers/8a7b8f4c-0c11-406f-bed6-b4fd18e3c304 => generated 1371 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:55:30.660521 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-16765907-8573-46a1-ba36-d33fc269ac4b tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822e6ac5ec8347c9815c770738509d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ced4a8a26d94c10b08bbca381d62d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:30.677587 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-16765907-8573-46a1-ba36-d33fc269ac4b tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] 10.222.0.115 "GET /compute/v2.1/servers/b4dbc5ca-f31e-44e8-9573-6e79e891b989" status: 200 len: 1319 microversion: 2.1 time: 0.529873 Aug 02 10:55:30.678940 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 27/66] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:55:30 2022] GET /compute/v2.1/servers/b4dbc5ca-f31e-44e8-9573-6e79e891b989 => generated 1319 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:55:30.693053 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-fed14112-583d-4562-980d-6c4b25a26b53 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:30.697734 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-fed14112-583d-4562-980d-6c4b25a26b53 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: b3a92fc5-5c44-48d1-8394-535687bb6ae3] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:30.712095 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-fed14112-583d-4562-980d-6c4b25a26b53 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:30.712624 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-fed14112-583d-4562-980d-6c4b25a26b53 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:30.713815 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-fed14112-583d-4562-980d-6c4b25a26b53 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:30.720139 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-fed14112-583d-4562-980d-6c4b25a26b53 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:30.825064 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-fed14112-583d-4562-980d-6c4b25a26b53 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:30.842664 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-fed14112-583d-4562-980d-6c4b25a26b53 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:30.848934 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-fed14112-583d-4562-980d-6c4b25a26b53 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:30.852013 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-fed14112-583d-4562-980d-6c4b25a26b53 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3" status: 200 len: 1342 microversion: 2.20 time: 0.168392 Aug 02 10:55:30.852013 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 28/67] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 10:55:30 2022] GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3 => generated 1342 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:55:30.875518 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-384d40f9-d103-4a21-8f5b-e9226b5afcf4 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:30.880356 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-384d40f9-d103-4a21-8f5b-e9226b5afcf4 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] [instance: 3938932a-e778-4c0c-9ab0-78dc9082a48e] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:30.896705 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-384d40f9-d103-4a21-8f5b-e9226b5afcf4 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:30.898082 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-384d40f9-d103-4a21-8f5b-e9226b5afcf4 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:30.899943 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-384d40f9-d103-4a21-8f5b-e9226b5afcf4 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:30.900606 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-384d40f9-d103-4a21-8f5b-e9226b5afcf4 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:31.049152 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-384d40f9-d103-4a21-8f5b-e9226b5afcf4 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f41f17f5154e01a699043edc350cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e92110a1545f1b84644b8971bb6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:31.071012 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-384d40f9-d103-4a21-8f5b-e9226b5afcf4 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] 10.222.0.115 "GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e" status: 200 len: 1298 microversion: 2.1 time: 0.211029 Aug 02 10:55:31.072867 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 29/68] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:55:30 2022] GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e => generated 1298 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:55:31.286122 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [req-cf16516f-5edf-4dc3-aab0-3f754d3bf26f req-8572d902-7b57-4c6d-9be9-9cffea559d85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a7b8f4c-0c11-406f-bed6-b4fd18e3c304", "tag": "a726c1ca-b762-4699-8bde-774b6f63a9dc"}]} {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:55:31.304556 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [req-cf16516f-5edf-4dc3-aab0-3f754d3bf26f req-8572d902-7b57-4c6d-9be9-9cffea559d85 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:31.305851 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [req-cf16516f-5edf-4dc3-aab0-3f754d3bf26f req-8572d902-7b57-4c6d-9be9-9cffea559d85 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:31.324324 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.compute.server_external_events [req-cf16516f-5edf-4dc3-aab0-3f754d3bf26f req-8572d902-7b57-4c6d-9be9-9cffea559d85 service nova] Creating event network-changed:a726c1ca-b762-4699-8bde-774b6f63a9dc for instance 8a7b8f4c-0c11-406f-bed6-b4fd18e3c304 on hv-cinder-85031 Aug 02 10:55:31.331598 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [req-cf16516f-5edf-4dc3-aab0-3f754d3bf26f req-8572d902-7b57-4c6d-9be9-9cffea559d85 service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.750747 Aug 02 10:55:31.332848 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 40/69] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Aug 2 10:55:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:55:31.603482 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-99eb2c61-a70d-4bc6-af29-0e518c0b5451 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:31.608463 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-99eb2c61-a70d-4bc6-af29-0e518c0b5451 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: 8a7b8f4c-0c11-406f-bed6-b4fd18e3c304] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:31.614245 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG dbcounter [-] [129952] Writing DB stats nova_cell0:SELECT=6 {{(pid=129952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:55:31.635353 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-99eb2c61-a70d-4bc6-af29-0e518c0b5451 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:31.635939 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-99eb2c61-a70d-4bc6-af29-0e518c0b5451 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:31.646787 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-99eb2c61-a70d-4bc6-af29-0e518c0b5451 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:31.650889 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-99eb2c61-a70d-4bc6-af29-0e518c0b5451 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:31.702518 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-7f8be71b-2471-4727-ac94-1063d122893c tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:31.703402 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-7f8be71b-2471-4727-ac94-1063d122893c tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] [instance: b4dbc5ca-f31e-44e8-9573-6e79e891b989] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:31.737044 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-7f8be71b-2471-4727-ac94-1063d122893c tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:31.737044 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-7f8be71b-2471-4727-ac94-1063d122893c tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:31.737044 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-7f8be71b-2471-4727-ac94-1063d122893c tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:31.737044 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-7f8be71b-2471-4727-ac94-1063d122893c tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:32.306148 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-99eb2c61-a70d-4bc6-af29-0e518c0b5451 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bc14ada1564911b2f0a698aef3f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a4a0cf1852449e8bfc59ddb5a902c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:32.320439 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-99eb2c61-a70d-4bc6-af29-0e518c0b5451 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "GET /compute/v2.1/servers/8a7b8f4c-0c11-406f-bed6-b4fd18e3c304" status: 200 len: 1371 microversion: 2.1 time: 0.715777 Aug 02 10:55:32.338007 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 30/70] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:55:31 2022] GET /compute/v2.1/servers/8a7b8f4c-0c11-406f-bed6-b4fd18e3c304 => generated 1371 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:55:32.352826 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-fe0106e9-f7ce-4ab0-a974-85ae3b9f9dee tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:32.353422 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-fe0106e9-f7ce-4ab0-a974-85ae3b9f9dee tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: b3a92fc5-5c44-48d1-8394-535687bb6ae3] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:32.369854 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-fe0106e9-f7ce-4ab0-a974-85ae3b9f9dee tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:32.370331 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-fe0106e9-f7ce-4ab0-a974-85ae3b9f9dee tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:32.371161 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-fe0106e9-f7ce-4ab0-a974-85ae3b9f9dee tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:32.371606 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-fe0106e9-f7ce-4ab0-a974-85ae3b9f9dee tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:32.371849 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-7f8be71b-2471-4727-ac94-1063d122893c tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822e6ac5ec8347c9815c770738509d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ced4a8a26d94c10b08bbca381d62d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:32.402798 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-7f8be71b-2471-4727-ac94-1063d122893c tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] 10.222.0.115 "GET /compute/v2.1/servers/b4dbc5ca-f31e-44e8-9573-6e79e891b989" status: 200 len: 1319 microversion: 2.1 time: 0.698269 Aug 02 10:55:32.405994 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 41/71] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:55:31 2022] GET /compute/v2.1/servers/b4dbc5ca-f31e-44e8-9573-6e79e891b989 => generated 1319 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:55:32.426055 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-2f9f414c-3340-474d-9cef-b6e7d1f3f15a tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:32.426683 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-2f9f414c-3340-474d-9cef-b6e7d1f3f15a tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] [instance: 3938932a-e778-4c0c-9ab0-78dc9082a48e] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:32.463287 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-2f9f414c-3340-474d-9cef-b6e7d1f3f15a tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:32.466806 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-2f9f414c-3340-474d-9cef-b6e7d1f3f15a tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:32.483945 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-2f9f414c-3340-474d-9cef-b6e7d1f3f15a tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:32.485087 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-2f9f414c-3340-474d-9cef-b6e7d1f3f15a tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:33.016169 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG dbcounter [-] [129953] Writing DB stats nova_cell0:SELECT=6 {{(pid=129953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:55:33.306030 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-fe0106e9-f7ce-4ab0-a974-85ae3b9f9dee tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:33.309670 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-2f9f414c-3340-474d-9cef-b6e7d1f3f15a tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f41f17f5154e01a699043edc350cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e92110a1545f1b84644b8971bb6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:33.349347 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-fe0106e9-f7ce-4ab0-a974-85ae3b9f9dee tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:33.357293 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-2f9f414c-3340-474d-9cef-b6e7d1f3f15a tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] 10.222.0.115 "GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e" status: 200 len: 1365 microversion: 2.1 time: 0.944392 Aug 02 10:55:33.359141 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 42/72] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:55:32 2022] GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e => generated 1365 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:55:33.360547 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-fe0106e9-f7ce-4ab0-a974-85ae3b9f9dee tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:33.368413 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-fe0106e9-f7ce-4ab0-a974-85ae3b9f9dee tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3" status: 200 len: 1410 microversion: 2.20 time: 1.024603 Aug 02 10:55:33.371727 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-476784af-bfcc-4fdc-959c-18bafc44f65b tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:33.372303 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 31/73] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 10:55:32 2022] GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3 => generated 1410 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:55:33.376079 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-476784af-bfcc-4fdc-959c-18bafc44f65b tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: 8a7b8f4c-0c11-406f-bed6-b4fd18e3c304] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:33.399731 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-476784af-bfcc-4fdc-959c-18bafc44f65b tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:33.400317 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-476784af-bfcc-4fdc-959c-18bafc44f65b tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:33.401193 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-476784af-bfcc-4fdc-959c-18bafc44f65b tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:33.401740 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-476784af-bfcc-4fdc-959c-18bafc44f65b tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:33.428719 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-17e15f42-b074-466b-b3b8-3879a6e93f78 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:33.429306 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-17e15f42-b074-466b-b3b8-3879a6e93f78 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] [instance: b4dbc5ca-f31e-44e8-9573-6e79e891b989] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:33.435770 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG dbcounter [-] [129953] Writing DB stats nova_cell1:SELECT=100 {{(pid=129953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:55:33.456550 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-17e15f42-b074-466b-b3b8-3879a6e93f78 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:33.460682 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-17e15f42-b074-466b-b3b8-3879a6e93f78 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:33.461756 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-17e15f42-b074-466b-b3b8-3879a6e93f78 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:33.464885 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-17e15f42-b074-466b-b3b8-3879a6e93f78 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:33.533864 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG dbcounter [-] [129952] Writing DB stats nova_cell1:SELECT=100 {{(pid=129952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:55:33.741132 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-476784af-bfcc-4fdc-959c-18bafc44f65b tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bc14ada1564911b2f0a698aef3f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a4a0cf1852449e8bfc59ddb5a902c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:33.751744 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-476784af-bfcc-4fdc-959c-18bafc44f65b tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "GET /compute/v2.1/servers/8a7b8f4c-0c11-406f-bed6-b4fd18e3c304" status: 200 len: 1371 microversion: 2.1 time: 0.390789 Aug 02 10:55:33.763426 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 43/74] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:55:33 2022] GET /compute/v2.1/servers/8a7b8f4c-0c11-406f-bed6-b4fd18e3c304 => generated 1371 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:55:33.801848 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-17e15f42-b074-466b-b3b8-3879a6e93f78 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822e6ac5ec8347c9815c770738509d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ced4a8a26d94c10b08bbca381d62d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:33.809721 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-17e15f42-b074-466b-b3b8-3879a6e93f78 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] 10.222.0.115 "GET /compute/v2.1/servers/b4dbc5ca-f31e-44e8-9573-6e79e891b989" status: 200 len: 1319 microversion: 2.1 time: 0.385425 Aug 02 10:55:33.810868 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 32/75] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:55:33 2022] GET /compute/v2.1/servers/b4dbc5ca-f31e-44e8-9573-6e79e891b989 => generated 1319 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:55:34.246275 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [req-fc6e09b7-8928-4905-a717-a6418345448a req-0e954e7e-9d7e-4d07-9442-7f542e700aee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3a92fc5-5c44-48d1-8394-535687bb6ae3", "tag": "03045dd7-30b5-4c87-bcb8-828046dbcd75"}]} {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:55:34.252989 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG dbcounter [-] [129953] Writing DB stats nova_cell0:SELECT=4 {{(pid=129953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:55:34.257527 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [req-fc6e09b7-8928-4905-a717-a6418345448a req-0e954e7e-9d7e-4d07-9442-7f542e700aee service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:34.257958 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [req-fc6e09b7-8928-4905-a717-a6418345448a req-0e954e7e-9d7e-4d07-9442-7f542e700aee service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:34.271735 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.compute.server_external_events [req-fc6e09b7-8928-4905-a717-a6418345448a req-0e954e7e-9d7e-4d07-9442-7f542e700aee service nova] Creating event network-changed:03045dd7-30b5-4c87-bcb8-828046dbcd75 for instance b3a92fc5-5c44-48d1-8394-535687bb6ae3 on hv-cinder-85031 Aug 02 10:55:34.276346 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [req-fc6e09b7-8928-4905-a717-a6418345448a req-0e954e7e-9d7e-4d07-9442-7f542e700aee service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034126 Aug 02 10:55:34.277171 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 44/76] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Aug 2 10:55:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:55:34.381198 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-9ea4afa6-f880-4567-b5c2-bda1adaf79ea tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:34.381946 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-9ea4afa6-f880-4567-b5c2-bda1adaf79ea tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] [instance: 3938932a-e778-4c0c-9ab0-78dc9082a48e] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:34.394412 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-9ea4afa6-f880-4567-b5c2-bda1adaf79ea tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:34.395318 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-9ea4afa6-f880-4567-b5c2-bda1adaf79ea tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:34.400724 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-9ea4afa6-f880-4567-b5c2-bda1adaf79ea tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:34.400724 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-9ea4afa6-f880-4567-b5c2-bda1adaf79ea tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:34.421088 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-ee477cc3-0f12-4b99-97b4-6e89d2827a5b tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:34.422110 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-ee477cc3-0f12-4b99-97b4-6e89d2827a5b tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: b3a92fc5-5c44-48d1-8394-535687bb6ae3] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:34.455955 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-ee477cc3-0f12-4b99-97b4-6e89d2827a5b tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:34.458053 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-ee477cc3-0f12-4b99-97b4-6e89d2827a5b tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:34.460263 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-ee477cc3-0f12-4b99-97b4-6e89d2827a5b tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:34.461913 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-ee477cc3-0f12-4b99-97b4-6e89d2827a5b tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:34.730517 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-9ea4afa6-f880-4567-b5c2-bda1adaf79ea tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f41f17f5154e01a699043edc350cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e92110a1545f1b84644b8971bb6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:34.742827 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-9ea4afa6-f880-4567-b5c2-bda1adaf79ea tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] 10.222.0.115 "GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e" status: 200 len: 1365 microversion: 2.1 time: 0.366413 Aug 02 10:55:34.748796 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 33/77] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:55:34 2022] GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e => generated 1365 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:55:34.777318 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-e367a9d9-cac9-4b2e-83cb-4a93b039f8d4 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:34.777318 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-e367a9d9-cac9-4b2e-83cb-4a93b039f8d4 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: 8a7b8f4c-0c11-406f-bed6-b4fd18e3c304] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:34.787186 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-e367a9d9-cac9-4b2e-83cb-4a93b039f8d4 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:34.790232 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-e367a9d9-cac9-4b2e-83cb-4a93b039f8d4 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:34.790232 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-e367a9d9-cac9-4b2e-83cb-4a93b039f8d4 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:34.790232 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-e367a9d9-cac9-4b2e-83cb-4a93b039f8d4 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:34.792404 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-ee477cc3-0f12-4b99-97b4-6e89d2827a5b tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:34.801387 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-ee477cc3-0f12-4b99-97b4-6e89d2827a5b tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:34.802888 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-ee477cc3-0f12-4b99-97b4-6e89d2827a5b tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:34.803903 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-ee477cc3-0f12-4b99-97b4-6e89d2827a5b tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3" status: 200 len: 1410 microversion: 2.20 time: 0.388760 Aug 02 10:55:34.804458 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 45/78] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 10:55:34 2022] GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3 => generated 1410 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:55:34.819286 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG dbcounter [-] [129952] Writing DB stats nova_cell0:SELECT=36 {{(pid=129952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:55:34.833002 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [req-954d91b1-6caa-4493-bdc0-6f38da4659f5 req-b695ac26-15ae-4b72-8d0c-eeed6f0e4f83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3938932a-e778-4c0c-9ab0-78dc9082a48e", "tag": "9f11ec7a-3435-4709-afef-46942fe71fcf"}]} {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:55:34.848770 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [req-954d91b1-6caa-4493-bdc0-6f38da4659f5 req-b695ac26-15ae-4b72-8d0c-eeed6f0e4f83 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:34.850034 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [req-954d91b1-6caa-4493-bdc0-6f38da4659f5 req-b695ac26-15ae-4b72-8d0c-eeed6f0e4f83 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:34.867970 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.compute.server_external_events [req-954d91b1-6caa-4493-bdc0-6f38da4659f5 req-b695ac26-15ae-4b72-8d0c-eeed6f0e4f83 service nova] Creating event network-changed:9f11ec7a-3435-4709-afef-46942fe71fcf for instance 3938932a-e778-4c0c-9ab0-78dc9082a48e on hv-cinder-85031 Aug 02 10:55:34.874672 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [req-954d91b1-6caa-4493-bdc0-6f38da4659f5 req-b695ac26-15ae-4b72-8d0c-eeed6f0e4f83 service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047078 Aug 02 10:55:34.877146 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 46/79] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Aug 2 10:55:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:55:34.885285 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-175a5cd8-566d-4e9e-bde1-28a85ac71b5d tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:34.886004 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-175a5cd8-566d-4e9e-bde1-28a85ac71b5d tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] [instance: b4dbc5ca-f31e-44e8-9573-6e79e891b989] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:34.907538 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-175a5cd8-566d-4e9e-bde1-28a85ac71b5d tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:34.908114 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-175a5cd8-566d-4e9e-bde1-28a85ac71b5d tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:34.909033 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-175a5cd8-566d-4e9e-bde1-28a85ac71b5d tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:34.909483 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-175a5cd8-566d-4e9e-bde1-28a85ac71b5d tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:34.995320 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-e367a9d9-cac9-4b2e-83cb-4a93b039f8d4 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bc14ada1564911b2f0a698aef3f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a4a0cf1852449e8bfc59ddb5a902c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:35.003774 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-e367a9d9-cac9-4b2e-83cb-4a93b039f8d4 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "GET /compute/v2.1/servers/8a7b8f4c-0c11-406f-bed6-b4fd18e3c304" status: 200 len: 1371 microversion: 2.1 time: 0.232325 Aug 02 10:55:35.004477 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 34/80] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:55:34 2022] GET /compute/v2.1/servers/8a7b8f4c-0c11-406f-bed6-b4fd18e3c304 => generated 1371 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:55:35.066886 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-175a5cd8-566d-4e9e-bde1-28a85ac71b5d tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822e6ac5ec8347c9815c770738509d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ced4a8a26d94c10b08bbca381d62d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:35.074380 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-175a5cd8-566d-4e9e-bde1-28a85ac71b5d tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] 10.222.0.115 "GET /compute/v2.1/servers/b4dbc5ca-f31e-44e8-9573-6e79e891b989" status: 200 len: 1319 microversion: 2.1 time: 0.195256 Aug 02 10:55:35.089468 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 47/81] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:55:34 2022] GET /compute/v2.1/servers/b4dbc5ca-f31e-44e8-9573-6e79e891b989 => generated 1319 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:55:35.767126 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-7d876fd3-d8ab-4161-ab7e-f90495305556 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:35.770759 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-7d876fd3-d8ab-4161-ab7e-f90495305556 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] [instance: 3938932a-e778-4c0c-9ab0-78dc9082a48e] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:35.776648 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-7d876fd3-d8ab-4161-ab7e-f90495305556 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:35.777327 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-7d876fd3-d8ab-4161-ab7e-f90495305556 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:35.778703 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-7d876fd3-d8ab-4161-ab7e-f90495305556 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:35.779471 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-7d876fd3-d8ab-4161-ab7e-f90495305556 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:35.829833 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-74ba5bcb-6e4b-4eb5-a72f-00b84eb1b825 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:35.830465 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-74ba5bcb-6e4b-4eb5-a72f-00b84eb1b825 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: b3a92fc5-5c44-48d1-8394-535687bb6ae3] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:35.842545 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-74ba5bcb-6e4b-4eb5-a72f-00b84eb1b825 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:35.843578 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-74ba5bcb-6e4b-4eb5-a72f-00b84eb1b825 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:35.848912 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-74ba5bcb-6e4b-4eb5-a72f-00b84eb1b825 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:35.848912 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-74ba5bcb-6e4b-4eb5-a72f-00b84eb1b825 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:36.136880 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-7d876fd3-d8ab-4161-ab7e-f90495305556 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f41f17f5154e01a699043edc350cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e92110a1545f1b84644b8971bb6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:36.147256 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-7d876fd3-d8ab-4161-ab7e-f90495305556 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] 10.222.0.115 "GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e" status: 200 len: 1365 microversion: 2.1 time: 0.385048 Aug 02 10:55:36.148013 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 35/82] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:55:35 2022] GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e => generated 1365 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:55:36.152736 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-d617fd7c-bc33-4363-919c-9b1013a7a37d tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:36.153532 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-d617fd7c-bc33-4363-919c-9b1013a7a37d tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: 8a7b8f4c-0c11-406f-bed6-b4fd18e3c304] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:36.159938 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-d617fd7c-bc33-4363-919c-9b1013a7a37d tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:36.160608 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-d617fd7c-bc33-4363-919c-9b1013a7a37d tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:36.161527 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-d617fd7c-bc33-4363-919c-9b1013a7a37d tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:36.162103 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-d617fd7c-bc33-4363-919c-9b1013a7a37d tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:36.187345 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-74ba5bcb-6e4b-4eb5-a72f-00b84eb1b825 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:36.217381 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-74ba5bcb-6e4b-4eb5-a72f-00b84eb1b825 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:36.229038 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-74ba5bcb-6e4b-4eb5-a72f-00b84eb1b825 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:36.232831 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-74ba5bcb-6e4b-4eb5-a72f-00b84eb1b825 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3" status: 200 len: 1410 microversion: 2.20 time: 0.408955 Aug 02 10:55:36.233830 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 48/83] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 10:55:35 2022] GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3 => generated 1410 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:55:36.257811 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-f2adccb0-48f6-451e-9644-71c427e54888 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:36.261461 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-f2adccb0-48f6-451e-9644-71c427e54888 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] [instance: b4dbc5ca-f31e-44e8-9573-6e79e891b989] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:36.277205 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-f2adccb0-48f6-451e-9644-71c427e54888 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:36.277654 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-f2adccb0-48f6-451e-9644-71c427e54888 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:36.279098 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-f2adccb0-48f6-451e-9644-71c427e54888 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:36.279520 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-f2adccb0-48f6-451e-9644-71c427e54888 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:36.865805 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-d617fd7c-bc33-4363-919c-9b1013a7a37d tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bc14ada1564911b2f0a698aef3f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a4a0cf1852449e8bfc59ddb5a902c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:36.877986 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-d617fd7c-bc33-4363-919c-9b1013a7a37d tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "GET /compute/v2.1/servers/8a7b8f4c-0c11-406f-bed6-b4fd18e3c304" status: 200 len: 1371 microversion: 2.1 time: 0.727034 Aug 02 10:55:36.880715 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 36/84] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:55:36 2022] GET /compute/v2.1/servers/8a7b8f4c-0c11-406f-bed6-b4fd18e3c304 => generated 1371 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:55:36.952546 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-f2adccb0-48f6-451e-9644-71c427e54888 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822e6ac5ec8347c9815c770738509d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ced4a8a26d94c10b08bbca381d62d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:36.960225 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-f2adccb0-48f6-451e-9644-71c427e54888 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] 10.222.0.115 "GET /compute/v2.1/servers/b4dbc5ca-f31e-44e8-9573-6e79e891b989" status: 200 len: 1319 microversion: 2.1 time: 0.724318 Aug 02 10:55:36.961813 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 49/85] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:55:36 2022] GET /compute/v2.1/servers/b4dbc5ca-f31e-44e8-9573-6e79e891b989 => generated 1319 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:55:37.173651 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-8a881d74-91e1-4d0d-a999-715563ac335d tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:37.174350 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-8a881d74-91e1-4d0d-a999-715563ac335d tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] [instance: 3938932a-e778-4c0c-9ab0-78dc9082a48e] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:37.181335 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-8a881d74-91e1-4d0d-a999-715563ac335d tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:37.182035 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-8a881d74-91e1-4d0d-a999-715563ac335d tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:37.183015 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-8a881d74-91e1-4d0d-a999-715563ac335d tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:37.183652 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-8a881d74-91e1-4d0d-a999-715563ac335d tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:37.256909 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-1474fa71-7298-4a51-819b-7f3915ffb1a2 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:37.257795 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-1474fa71-7298-4a51-819b-7f3915ffb1a2 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: b3a92fc5-5c44-48d1-8394-535687bb6ae3] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:37.261148 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG dbcounter [-] [129953] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=5 {{(pid=129953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:55:37.269108 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-1474fa71-7298-4a51-819b-7f3915ffb1a2 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:37.269710 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-1474fa71-7298-4a51-819b-7f3915ffb1a2 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:37.270865 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-1474fa71-7298-4a51-819b-7f3915ffb1a2 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:37.271583 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-1474fa71-7298-4a51-819b-7f3915ffb1a2 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:37.442801 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-8a881d74-91e1-4d0d-a999-715563ac335d tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f41f17f5154e01a699043edc350cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e92110a1545f1b84644b8971bb6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:37.457725 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-8a881d74-91e1-4d0d-a999-715563ac335d tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] 10.222.0.115 "GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e" status: 200 len: 1365 microversion: 2.1 time: 0.288669 Aug 02 10:55:37.474227 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 37/86] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:55:37 2022] GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e => generated 1365 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:55:37.606309 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-1474fa71-7298-4a51-819b-7f3915ffb1a2 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:37.617478 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-1474fa71-7298-4a51-819b-7f3915ffb1a2 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:37.619264 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-1474fa71-7298-4a51-819b-7f3915ffb1a2 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:37.620505 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-1474fa71-7298-4a51-819b-7f3915ffb1a2 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3" status: 200 len: 1410 microversion: 2.20 time: 0.367540 Aug 02 10:55:37.626160 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 50/87] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 10:55:37 2022] GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3 => generated 1410 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:55:37.901842 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-76854b0a-5fb0-4148-bd21-389ec0006d2f tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:37.902777 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-76854b0a-5fb0-4148-bd21-389ec0006d2f tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: 8a7b8f4c-0c11-406f-bed6-b4fd18e3c304] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:37.911696 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-76854b0a-5fb0-4148-bd21-389ec0006d2f tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:37.912654 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-76854b0a-5fb0-4148-bd21-389ec0006d2f tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:37.913908 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-76854b0a-5fb0-4148-bd21-389ec0006d2f tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:37.914556 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-76854b0a-5fb0-4148-bd21-389ec0006d2f tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:37.991197 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-4dc55f45-cedc-477c-a1e9-02bd1cc9603d tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:37.992819 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-4dc55f45-cedc-477c-a1e9-02bd1cc9603d tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] [instance: b4dbc5ca-f31e-44e8-9573-6e79e891b989] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:38.009036 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-4dc55f45-cedc-477c-a1e9-02bd1cc9603d tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:38.010451 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-4dc55f45-cedc-477c-a1e9-02bd1cc9603d tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:38.018824 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-4dc55f45-cedc-477c-a1e9-02bd1cc9603d tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:38.018824 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-4dc55f45-cedc-477c-a1e9-02bd1cc9603d tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:38.223142 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-76854b0a-5fb0-4148-bd21-389ec0006d2f tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bc14ada1564911b2f0a698aef3f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a4a0cf1852449e8bfc59ddb5a902c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:38.229495 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-76854b0a-5fb0-4148-bd21-389ec0006d2f tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "GET /compute/v2.1/servers/8a7b8f4c-0c11-406f-bed6-b4fd18e3c304" status: 200 len: 1371 microversion: 2.1 time: 0.331419 Aug 02 10:55:38.230295 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 38/88] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:55:37 2022] GET /compute/v2.1/servers/8a7b8f4c-0c11-406f-bed6-b4fd18e3c304 => generated 1371 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:55:38.314021 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-4dc55f45-cedc-477c-a1e9-02bd1cc9603d tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822e6ac5ec8347c9815c770738509d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ced4a8a26d94c10b08bbca381d62d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:38.323221 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-4dc55f45-cedc-477c-a1e9-02bd1cc9603d tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] 10.222.0.115 "GET /compute/v2.1/servers/b4dbc5ca-f31e-44e8-9573-6e79e891b989" status: 200 len: 1319 microversion: 2.1 time: 0.344638 Aug 02 10:55:38.323809 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 51/89] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:55:37 2022] GET /compute/v2.1/servers/b4dbc5ca-f31e-44e8-9573-6e79e891b989 => generated 1319 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:55:38.483117 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-f1584338-8b21-4b5e-b684-18494bfa6875 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:38.483471 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-f1584338-8b21-4b5e-b684-18494bfa6875 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] [instance: 3938932a-e778-4c0c-9ab0-78dc9082a48e] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:38.490633 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-f1584338-8b21-4b5e-b684-18494bfa6875 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:38.491168 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-f1584338-8b21-4b5e-b684-18494bfa6875 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:38.492036 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-f1584338-8b21-4b5e-b684-18494bfa6875 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:38.492513 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-f1584338-8b21-4b5e-b684-18494bfa6875 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:38.627226 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-f1584338-8b21-4b5e-b684-18494bfa6875 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f41f17f5154e01a699043edc350cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e92110a1545f1b84644b8971bb6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:38.634596 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-f1584338-8b21-4b5e-b684-18494bfa6875 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] 10.222.0.115 "GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e" status: 200 len: 1365 microversion: 2.1 time: 0.156511 Aug 02 10:55:38.635186 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 39/90] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:55:38 2022] GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:55:38.644223 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-62b72bb4-4607-4a74-ad89-7e03373d6d83 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:38.644827 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-62b72bb4-4607-4a74-ad89-7e03373d6d83 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: b3a92fc5-5c44-48d1-8394-535687bb6ae3] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:38.650635 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-62b72bb4-4607-4a74-ad89-7e03373d6d83 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:38.651106 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-62b72bb4-4607-4a74-ad89-7e03373d6d83 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:38.651862 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-62b72bb4-4607-4a74-ad89-7e03373d6d83 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:38.652287 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-62b72bb4-4607-4a74-ad89-7e03373d6d83 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:38.798171 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-62b72bb4-4607-4a74-ad89-7e03373d6d83 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:38.806330 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-62b72bb4-4607-4a74-ad89-7e03373d6d83 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:38.807882 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-62b72bb4-4607-4a74-ad89-7e03373d6d83 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:38.808984 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-62b72bb4-4607-4a74-ad89-7e03373d6d83 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3" status: 200 len: 1410 microversion: 2.20 time: 0.168631 Aug 02 10:55:38.810030 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 52/91] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 10:55:38 2022] GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3 => generated 1410 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:55:39.257019 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-393ca3e5-d924-4f25-bc4c-7d26a2fe164a tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:39.258203 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-393ca3e5-d924-4f25-bc4c-7d26a2fe164a tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: 8a7b8f4c-0c11-406f-bed6-b4fd18e3c304] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:39.264939 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-393ca3e5-d924-4f25-bc4c-7d26a2fe164a tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:39.265382 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-393ca3e5-d924-4f25-bc4c-7d26a2fe164a tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:39.266321 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-393ca3e5-d924-4f25-bc4c-7d26a2fe164a tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:39.266753 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-393ca3e5-d924-4f25-bc4c-7d26a2fe164a tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:39.345734 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-1e0ee6b2-8194-4ed1-8e36-f05e4a37d1ee tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:39.346690 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-1e0ee6b2-8194-4ed1-8e36-f05e4a37d1ee tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] [instance: b4dbc5ca-f31e-44e8-9573-6e79e891b989] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:39.352757 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-1e0ee6b2-8194-4ed1-8e36-f05e4a37d1ee tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:39.353207 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-1e0ee6b2-8194-4ed1-8e36-f05e4a37d1ee tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:39.353988 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-1e0ee6b2-8194-4ed1-8e36-f05e4a37d1ee tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:39.354423 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-1e0ee6b2-8194-4ed1-8e36-f05e4a37d1ee tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:39.460505 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-393ca3e5-d924-4f25-bc4c-7d26a2fe164a tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bc14ada1564911b2f0a698aef3f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a4a0cf1852449e8bfc59ddb5a902c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:39.474663 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-393ca3e5-d924-4f25-bc4c-7d26a2fe164a tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "GET /compute/v2.1/servers/8a7b8f4c-0c11-406f-bed6-b4fd18e3c304" status: 200 len: 1371 microversion: 2.1 time: 0.219107 Aug 02 10:55:39.479133 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 40/92] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:55:39 2022] GET /compute/v2.1/servers/8a7b8f4c-0c11-406f-bed6-b4fd18e3c304 => generated 1371 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:55:39.572260 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-1e0ee6b2-8194-4ed1-8e36-f05e4a37d1ee tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822e6ac5ec8347c9815c770738509d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ced4a8a26d94c10b08bbca381d62d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:39.593863 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-1e0ee6b2-8194-4ed1-8e36-f05e4a37d1ee tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] 10.222.0.115 "GET /compute/v2.1/servers/b4dbc5ca-f31e-44e8-9573-6e79e891b989" status: 200 len: 1319 microversion: 2.1 time: 0.252834 Aug 02 10:55:39.595631 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 53/93] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:55:39 2022] GET /compute/v2.1/servers/b4dbc5ca-f31e-44e8-9573-6e79e891b989 => generated 1319 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:55:39.657102 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-59dd18f7-d740-482e-9fd1-08e03820d8ce tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:39.657717 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-59dd18f7-d740-482e-9fd1-08e03820d8ce tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] [instance: 3938932a-e778-4c0c-9ab0-78dc9082a48e] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:39.667637 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-59dd18f7-d740-482e-9fd1-08e03820d8ce tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:39.668095 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-59dd18f7-d740-482e-9fd1-08e03820d8ce tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:39.668929 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-59dd18f7-d740-482e-9fd1-08e03820d8ce tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:39.669859 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-59dd18f7-d740-482e-9fd1-08e03820d8ce tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:39.836410 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-438d31f5-bdca-4591-8b45-ae079156a763 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:39.837514 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-438d31f5-bdca-4591-8b45-ae079156a763 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: b3a92fc5-5c44-48d1-8394-535687bb6ae3] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:39.850136 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-438d31f5-bdca-4591-8b45-ae079156a763 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:39.855440 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-438d31f5-bdca-4591-8b45-ae079156a763 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:39.857130 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-438d31f5-bdca-4591-8b45-ae079156a763 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:39.857775 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-438d31f5-bdca-4591-8b45-ae079156a763 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:39.869882 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-59dd18f7-d740-482e-9fd1-08e03820d8ce tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f41f17f5154e01a699043edc350cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e92110a1545f1b84644b8971bb6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:39.880846 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-59dd18f7-d740-482e-9fd1-08e03820d8ce tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] 10.222.0.115 "GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e" status: 200 len: 1365 microversion: 2.1 time: 0.228432 Aug 02 10:55:39.881919 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 41/94] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:55:39 2022] GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e => generated 1365 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:55:40.056853 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-438d31f5-bdca-4591-8b45-ae079156a763 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:40.083175 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-438d31f5-bdca-4591-8b45-ae079156a763 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:40.085733 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-438d31f5-bdca-4591-8b45-ae079156a763 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:40.086830 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [req-4fc6392d-dd82-4b6d-9833-542047be2487 req-869661d3-fb9a-4362-9fcf-c3b0702c7e0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a7b8f4c-0c11-406f-bed6-b4fd18e3c304", "name": "network-vif-plugged", "status": "completed", "tag": "a726c1ca-b762-4699-8bde-774b6f63a9dc"}]} {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:55:40.088694 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-438d31f5-bdca-4591-8b45-ae079156a763 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3" status: 200 len: 1410 microversion: 2.20 time: 0.258517 Aug 02 10:55:40.090145 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 54/95] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 10:55:39 2022] GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3 => generated 1410 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:55:40.101230 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [req-4fc6392d-dd82-4b6d-9833-542047be2487 req-869661d3-fb9a-4362-9fcf-c3b0702c7e0c service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:40.102719 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [req-4fc6392d-dd82-4b6d-9833-542047be2487 req-869661d3-fb9a-4362-9fcf-c3b0702c7e0c service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:40.123973 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.compute.server_external_events [req-4fc6392d-dd82-4b6d-9833-542047be2487 req-869661d3-fb9a-4362-9fcf-c3b0702c7e0c service nova] Creating event network-vif-plugged:a726c1ca-b762-4699-8bde-774b6f63a9dc for instance 8a7b8f4c-0c11-406f-bed6-b4fd18e3c304 on hv-cinder-85031 Aug 02 10:55:40.124481 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [req-4fc6392d-dd82-4b6d-9833-542047be2487 req-869661d3-fb9a-4362-9fcf-c3b0702c7e0c service nova] Acquired lock "compute-rpcapi-router" {{(pid=129952) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 02 10:55:40.125641 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-905d0cbc-9c79-45eb-a9be-3dec9033b02a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:40.126066 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-905d0cbc-9c79-45eb-a9be-3dec9033b02a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:40.127069 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-905d0cbc-9c79-45eb-a9be-3dec9033b02a None None] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:40.127680 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-905d0cbc-9c79-45eb-a9be-3dec9033b02a None None] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:40.136265 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.compute.rpcapi [None req-905d0cbc-9c79-45eb-a9be-3dec9033b02a None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 02 10:55:40.137258 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-905d0cbc-9c79-45eb-a9be-3dec9033b02a None None] Releasing lock "compute-rpcapi-router" {{(pid=129952) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 02 10:55:40.155764 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-905d0cbc-9c79-45eb-a9be-3dec9033b02a None None] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153223 Aug 02 10:55:40.156387 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 42/96] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Aug 2 10:55:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:55:40.498058 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-9720a659-a99e-4875-a496-a5178f895220 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:40.499232 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-9720a659-a99e-4875-a496-a5178f895220 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: 8a7b8f4c-0c11-406f-bed6-b4fd18e3c304] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:40.505535 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-9720a659-a99e-4875-a496-a5178f895220 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:40.505971 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-9720a659-a99e-4875-a496-a5178f895220 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:40.506877 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-9720a659-a99e-4875-a496-a5178f895220 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:40.507337 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-9720a659-a99e-4875-a496-a5178f895220 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:40.617469 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-7176fdb8-b179-4168-b1d9-8514d3e89112 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:40.618254 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-7176fdb8-b179-4168-b1d9-8514d3e89112 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] [instance: b4dbc5ca-f31e-44e8-9573-6e79e891b989] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:40.625608 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-7176fdb8-b179-4168-b1d9-8514d3e89112 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:40.626763 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-7176fdb8-b179-4168-b1d9-8514d3e89112 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:40.627917 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-7176fdb8-b179-4168-b1d9-8514d3e89112 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:40.637226 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-7176fdb8-b179-4168-b1d9-8514d3e89112 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:40.780549 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-9720a659-a99e-4875-a496-a5178f895220 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bc14ada1564911b2f0a698aef3f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a4a0cf1852449e8bfc59ddb5a902c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:40.786206 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-9720a659-a99e-4875-a496-a5178f895220 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "GET /compute/v2.1/servers/8a7b8f4c-0c11-406f-bed6-b4fd18e3c304" status: 200 len: 1371 microversion: 2.1 time: 0.292356 Aug 02 10:55:40.800043 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 55/97] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:55:40 2022] GET /compute/v2.1/servers/8a7b8f4c-0c11-406f-bed6-b4fd18e3c304 => generated 1371 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:55:40.847339 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-7176fdb8-b179-4168-b1d9-8514d3e89112 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822e6ac5ec8347c9815c770738509d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ced4a8a26d94c10b08bbca381d62d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:40.855445 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-7176fdb8-b179-4168-b1d9-8514d3e89112 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] 10.222.0.115 "GET /compute/v2.1/servers/b4dbc5ca-f31e-44e8-9573-6e79e891b989" status: 200 len: 1319 microversion: 2.1 time: 0.242283 Aug 02 10:55:40.857326 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 43/98] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:55:40 2022] GET /compute/v2.1/servers/b4dbc5ca-f31e-44e8-9573-6e79e891b989 => generated 1319 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:55:40.902959 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-3359b050-713e-43b5-bafb-f1b4090b8f9a tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:40.904263 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-3359b050-713e-43b5-bafb-f1b4090b8f9a tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] [instance: 3938932a-e778-4c0c-9ab0-78dc9082a48e] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:40.910556 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-3359b050-713e-43b5-bafb-f1b4090b8f9a tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:40.911005 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-3359b050-713e-43b5-bafb-f1b4090b8f9a tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:40.911968 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-3359b050-713e-43b5-bafb-f1b4090b8f9a tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:40.912407 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-3359b050-713e-43b5-bafb-f1b4090b8f9a tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:41.080993 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-3359b050-713e-43b5-bafb-f1b4090b8f9a tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f41f17f5154e01a699043edc350cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e92110a1545f1b84644b8971bb6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:41.091591 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-3359b050-713e-43b5-bafb-f1b4090b8f9a tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] 10.222.0.115 "GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e" status: 200 len: 1365 microversion: 2.1 time: 0.192313 Aug 02 10:55:41.111267 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 56/99] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:55:40 2022] GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e => generated 1365 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:55:41.116694 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-650ec253-7ec3-4969-970a-c8ee79432cb8 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:41.117599 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-650ec253-7ec3-4969-970a-c8ee79432cb8 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: b3a92fc5-5c44-48d1-8394-535687bb6ae3] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:41.134146 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-650ec253-7ec3-4969-970a-c8ee79432cb8 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:41.139478 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-650ec253-7ec3-4969-970a-c8ee79432cb8 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:41.140365 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-650ec253-7ec3-4969-970a-c8ee79432cb8 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:41.140806 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-650ec253-7ec3-4969-970a-c8ee79432cb8 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:41.338909 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-650ec253-7ec3-4969-970a-c8ee79432cb8 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:41.360610 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-650ec253-7ec3-4969-970a-c8ee79432cb8 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:41.362134 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-650ec253-7ec3-4969-970a-c8ee79432cb8 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:41.363302 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-650ec253-7ec3-4969-970a-c8ee79432cb8 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3" status: 200 len: 1410 microversion: 2.20 time: 0.252885 Aug 02 10:55:41.375555 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 44/100] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 10:55:41 2022] GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3 => generated 1410 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:55:41.810682 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-c0d14efe-3ab2-42b1-8665-ab8c5e044930 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:41.812098 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-c0d14efe-3ab2-42b1-8665-ab8c5e044930 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: 8a7b8f4c-0c11-406f-bed6-b4fd18e3c304] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:41.821621 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-c0d14efe-3ab2-42b1-8665-ab8c5e044930 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:41.822407 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-c0d14efe-3ab2-42b1-8665-ab8c5e044930 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:41.823558 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-c0d14efe-3ab2-42b1-8665-ab8c5e044930 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:41.824288 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-c0d14efe-3ab2-42b1-8665-ab8c5e044930 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:41.879921 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-1eddc2bd-634c-450a-9052-163dc994ddbb tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:41.881112 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-1eddc2bd-634c-450a-9052-163dc994ddbb tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] [instance: b4dbc5ca-f31e-44e8-9573-6e79e891b989] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:41.891381 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-1eddc2bd-634c-450a-9052-163dc994ddbb tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:41.891381 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-1eddc2bd-634c-450a-9052-163dc994ddbb tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:41.891978 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-1eddc2bd-634c-450a-9052-163dc994ddbb tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:41.892727 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-1eddc2bd-634c-450a-9052-163dc994ddbb tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:42.033334 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-c0d14efe-3ab2-42b1-8665-ab8c5e044930 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bc14ada1564911b2f0a698aef3f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a4a0cf1852449e8bfc59ddb5a902c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:42.046551 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-c0d14efe-3ab2-42b1-8665-ab8c5e044930 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "GET /compute/v2.1/servers/8a7b8f4c-0c11-406f-bed6-b4fd18e3c304" status: 200 len: 1371 microversion: 2.1 time: 0.242500 Aug 02 10:55:42.047335 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 57/101] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:55:41 2022] GET /compute/v2.1/servers/8a7b8f4c-0c11-406f-bed6-b4fd18e3c304 => generated 1371 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:55:42.117341 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-1eddc2bd-634c-450a-9052-163dc994ddbb tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822e6ac5ec8347c9815c770738509d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ced4a8a26d94c10b08bbca381d62d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:42.122580 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-a717ae46-2f33-4b62-84e4-f030c9c82988 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:42.123318 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-a717ae46-2f33-4b62-84e4-f030c9c82988 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] [instance: 3938932a-e778-4c0c-9ab0-78dc9082a48e] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:42.127088 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-1eddc2bd-634c-450a-9052-163dc994ddbb tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] 10.222.0.115 "GET /compute/v2.1/servers/b4dbc5ca-f31e-44e8-9573-6e79e891b989" status: 200 len: 1319 microversion: 2.1 time: 0.251582 Aug 02 10:55:42.131890 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-a717ae46-2f33-4b62-84e4-f030c9c82988 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:42.135438 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-a717ae46-2f33-4b62-84e4-f030c9c82988 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:42.136479 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-a717ae46-2f33-4b62-84e4-f030c9c82988 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:42.136996 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-a717ae46-2f33-4b62-84e4-f030c9c82988 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:42.143898 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 45/102] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:55:41 2022] GET /compute/v2.1/servers/b4dbc5ca-f31e-44e8-9573-6e79e891b989 => generated 1319 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:55:42.177306 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [req-a7171776-1f58-4ae4-9251-0daf833bd8f8 req-43b8cc6f-1489-42e2-9db4-ce3a5adbc052 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4dbc5ca-f31e-44e8-9573-6e79e891b989", "name": "network-vif-plugged", "status": "completed", "tag": "86f8bd72-e159-4310-b36a-1444e34459c4"}, {"server_uuid": "3938932a-e778-4c0c-9ab0-78dc9082a48e", "name": "network-vif-plugged", "status": "completed", "tag": "9f11ec7a-3435-4709-afef-46942fe71fcf"}]} {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:55:42.188521 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [req-a7171776-1f58-4ae4-9251-0daf833bd8f8 req-43b8cc6f-1489-42e2-9db4-ce3a5adbc052 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:42.189211 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [req-a7171776-1f58-4ae4-9251-0daf833bd8f8 req-43b8cc6f-1489-42e2-9db4-ce3a5adbc052 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:42.207552 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.compute.server_external_events [req-a7171776-1f58-4ae4-9251-0daf833bd8f8 req-43b8cc6f-1489-42e2-9db4-ce3a5adbc052 service nova] Creating event network-vif-plugged:86f8bd72-e159-4310-b36a-1444e34459c4 for instance b4dbc5ca-f31e-44e8-9573-6e79e891b989 on hv-cinder-85031 Aug 02 10:55:42.208185 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.compute.server_external_events [req-a7171776-1f58-4ae4-9251-0daf833bd8f8 req-43b8cc6f-1489-42e2-9db4-ce3a5adbc052 service nova] Creating event network-vif-plugged:9f11ec7a-3435-4709-afef-46942fe71fcf for instance 3938932a-e778-4c0c-9ab0-78dc9082a48e on hv-cinder-85031 Aug 02 10:55:42.216638 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [req-a7171776-1f58-4ae4-9251-0daf833bd8f8 req-43b8cc6f-1489-42e2-9db4-ce3a5adbc052 service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.042185 Aug 02 10:55:42.218095 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 46/103] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Aug 2 10:55:42 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:55:42.309565 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-a717ae46-2f33-4b62-84e4-f030c9c82988 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f41f17f5154e01a699043edc350cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e92110a1545f1b84644b8971bb6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:42.317782 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-a717ae46-2f33-4b62-84e4-f030c9c82988 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] 10.222.0.115 "GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e" status: 200 len: 1365 microversion: 2.1 time: 0.199690 Aug 02 10:55:42.319088 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 58/104] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:55:42 2022] GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e => generated 1365 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:55:42.386568 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-45cfcaea-5ee4-42d5-9463-3a0caa62c4bb tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:42.387317 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-45cfcaea-5ee4-42d5-9463-3a0caa62c4bb tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: b3a92fc5-5c44-48d1-8394-535687bb6ae3] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:42.409999 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-45cfcaea-5ee4-42d5-9463-3a0caa62c4bb tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:42.410620 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-45cfcaea-5ee4-42d5-9463-3a0caa62c4bb tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:42.414166 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-45cfcaea-5ee4-42d5-9463-3a0caa62c4bb tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:42.416793 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-45cfcaea-5ee4-42d5-9463-3a0caa62c4bb tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:42.708901 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-45cfcaea-5ee4-42d5-9463-3a0caa62c4bb tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:42.719807 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-45cfcaea-5ee4-42d5-9463-3a0caa62c4bb tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:42.721651 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-45cfcaea-5ee4-42d5-9463-3a0caa62c4bb tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:42.722792 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-45cfcaea-5ee4-42d5-9463-3a0caa62c4bb tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3" status: 200 len: 1410 microversion: 2.20 time: 0.340709 Aug 02 10:55:42.723603 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 47/105] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 10:55:42 2022] GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3 => generated 1410 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:55:43.067650 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-662ab3d3-4e4b-4f7a-baae-08204985034d tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:43.068271 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-662ab3d3-4e4b-4f7a-baae-08204985034d tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: 8a7b8f4c-0c11-406f-bed6-b4fd18e3c304] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:43.074259 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-662ab3d3-4e4b-4f7a-baae-08204985034d tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:43.074716 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-662ab3d3-4e4b-4f7a-baae-08204985034d tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:43.076183 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-662ab3d3-4e4b-4f7a-baae-08204985034d tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:43.076717 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-662ab3d3-4e4b-4f7a-baae-08204985034d tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:43.149870 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-98a24deb-300e-43a9-9c16-a2d894f53fcf tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:43.150483 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-98a24deb-300e-43a9-9c16-a2d894f53fcf tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] [instance: b4dbc5ca-f31e-44e8-9573-6e79e891b989] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:43.156545 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-98a24deb-300e-43a9-9c16-a2d894f53fcf tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:43.156986 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-98a24deb-300e-43a9-9c16-a2d894f53fcf tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:43.157731 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-98a24deb-300e-43a9-9c16-a2d894f53fcf tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:43.158160 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-98a24deb-300e-43a9-9c16-a2d894f53fcf tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:43.245130 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-662ab3d3-4e4b-4f7a-baae-08204985034d tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bc14ada1564911b2f0a698aef3f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a4a0cf1852449e8bfc59ddb5a902c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:43.253520 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-662ab3d3-4e4b-4f7a-baae-08204985034d tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "GET /compute/v2.1/servers/8a7b8f4c-0c11-406f-bed6-b4fd18e3c304" status: 200 len: 1371 microversion: 2.1 time: 0.189626 Aug 02 10:55:43.254114 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 59/106] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:55:43 2022] GET /compute/v2.1/servers/8a7b8f4c-0c11-406f-bed6-b4fd18e3c304 => generated 1371 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:55:43.321719 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-98a24deb-300e-43a9-9c16-a2d894f53fcf tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822e6ac5ec8347c9815c770738509d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ced4a8a26d94c10b08bbca381d62d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:43.330652 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-98a24deb-300e-43a9-9c16-a2d894f53fcf tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] 10.222.0.115 "GET /compute/v2.1/servers/b4dbc5ca-f31e-44e8-9573-6e79e891b989" status: 200 len: 1319 microversion: 2.1 time: 0.184600 Aug 02 10:55:43.331255 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 48/107] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:55:43 2022] GET /compute/v2.1/servers/b4dbc5ca-f31e-44e8-9573-6e79e891b989 => generated 1319 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:55:43.340458 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-d489a4ad-9df5-46cc-9288-b4ede1971868 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:43.341068 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-d489a4ad-9df5-46cc-9288-b4ede1971868 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] [instance: 3938932a-e778-4c0c-9ab0-78dc9082a48e] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:43.348191 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-d489a4ad-9df5-46cc-9288-b4ede1971868 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:43.349014 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-d489a4ad-9df5-46cc-9288-b4ede1971868 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:43.349936 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-d489a4ad-9df5-46cc-9288-b4ede1971868 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:43.350519 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-d489a4ad-9df5-46cc-9288-b4ede1971868 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:43.555930 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-d489a4ad-9df5-46cc-9288-b4ede1971868 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f41f17f5154e01a699043edc350cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e92110a1545f1b84644b8971bb6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:43.564401 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-d489a4ad-9df5-46cc-9288-b4ede1971868 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] 10.222.0.115 "GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e" status: 200 len: 1365 microversion: 2.1 time: 0.227818 Aug 02 10:55:43.564979 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 60/108] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:55:43 2022] GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e => generated 1365 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:55:43.750182 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-b7db3d0a-6846-46aa-abec-58d196135053 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:43.752085 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-b7db3d0a-6846-46aa-abec-58d196135053 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: b3a92fc5-5c44-48d1-8394-535687bb6ae3] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:43.758583 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-b7db3d0a-6846-46aa-abec-58d196135053 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:43.759030 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-b7db3d0a-6846-46aa-abec-58d196135053 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:43.759919 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-b7db3d0a-6846-46aa-abec-58d196135053 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:43.760355 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-b7db3d0a-6846-46aa-abec-58d196135053 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:43.903817 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-b7db3d0a-6846-46aa-abec-58d196135053 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:43.929261 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-b7db3d0a-6846-46aa-abec-58d196135053 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:43.939696 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-b7db3d0a-6846-46aa-abec-58d196135053 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:43.947072 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-b7db3d0a-6846-46aa-abec-58d196135053 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3" status: 200 len: 1410 microversion: 2.20 time: 0.199955 Aug 02 10:55:43.959260 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 49/109] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 10:55:43 2022] GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3 => generated 1410 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:55:44.236002 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [req-b762bd01-4d96-4afe-99ff-3c719d3c224b req-5727bf63-ce79-4714-8a6a-b8fa90523efb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3a92fc5-5c44-48d1-8394-535687bb6ae3", "name": "network-vif-plugged", "status": "completed", "tag": "03045dd7-30b5-4c87-bcb8-828046dbcd75"}]} {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:55:44.251302 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [req-b762bd01-4d96-4afe-99ff-3c719d3c224b req-5727bf63-ce79-4714-8a6a-b8fa90523efb service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:44.251744 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [req-b762bd01-4d96-4afe-99ff-3c719d3c224b req-5727bf63-ce79-4714-8a6a-b8fa90523efb service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:44.278732 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG dbcounter [-] [129953] Writing DB stats nova_cell1:SELECT=100 {{(pid=129953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:55:44.282047 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.compute.server_external_events [req-b762bd01-4d96-4afe-99ff-3c719d3c224b req-5727bf63-ce79-4714-8a6a-b8fa90523efb service nova] Creating event network-vif-plugged:03045dd7-30b5-4c87-bcb8-828046dbcd75 for instance b3a92fc5-5c44-48d1-8394-535687bb6ae3 on hv-cinder-85031 Aug 02 10:55:44.283718 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-85e09642-329e-4192-a279-42a32f9a75da tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:44.287392 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-85e09642-329e-4192-a279-42a32f9a75da tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: 8a7b8f4c-0c11-406f-bed6-b4fd18e3c304] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:44.291674 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [req-b762bd01-4d96-4afe-99ff-3c719d3c224b req-5727bf63-ce79-4714-8a6a-b8fa90523efb service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060437 Aug 02 10:55:44.292827 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 61/110] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Aug 2 10:55:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:55:44.304415 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-85e09642-329e-4192-a279-42a32f9a75da tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:44.305228 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-85e09642-329e-4192-a279-42a32f9a75da tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:44.306637 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-85e09642-329e-4192-a279-42a32f9a75da tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:44.307395 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-85e09642-329e-4192-a279-42a32f9a75da tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:44.333996 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG dbcounter [-] [129952] Writing DB stats nova_cell1:SELECT=100 {{(pid=129952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:55:44.356743 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-43257624-8f7e-4504-84e1-5e884a27f650 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:44.357611 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-43257624-8f7e-4504-84e1-5e884a27f650 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] [instance: b4dbc5ca-f31e-44e8-9573-6e79e891b989] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:44.367124 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-43257624-8f7e-4504-84e1-5e884a27f650 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:44.367124 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-43257624-8f7e-4504-84e1-5e884a27f650 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:44.367124 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-43257624-8f7e-4504-84e1-5e884a27f650 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:44.367124 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-43257624-8f7e-4504-84e1-5e884a27f650 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:44.507385 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-85e09642-329e-4192-a279-42a32f9a75da tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bc14ada1564911b2f0a698aef3f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a4a0cf1852449e8bfc59ddb5a902c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:44.517470 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-85e09642-329e-4192-a279-42a32f9a75da tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "GET /compute/v2.1/servers/8a7b8f4c-0c11-406f-bed6-b4fd18e3c304" status: 200 len: 1562 microversion: 2.1 time: 0.246914 Aug 02 10:55:44.531136 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 50/111] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:55:44 2022] GET /compute/v2.1/servers/8a7b8f4c-0c11-406f-bed6-b4fd18e3c304 => generated 1562 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:55:44.540781 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-bb60bfb4-0eb4-42a7-8a97-036fcf5a34cb tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:44.541576 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-bb60bfb4-0eb4-42a7-8a97-036fcf5a34cb tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: 8a7b8f4c-0c11-406f-bed6-b4fd18e3c304] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:44.548649 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-bb60bfb4-0eb4-42a7-8a97-036fcf5a34cb tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:44.549373 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-bb60bfb4-0eb4-42a7-8a97-036fcf5a34cb tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:44.550393 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-bb60bfb4-0eb4-42a7-8a97-036fcf5a34cb tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:44.551243 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-bb60bfb4-0eb4-42a7-8a97-036fcf5a34cb tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:44.563607 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-43257624-8f7e-4504-84e1-5e884a27f650 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822e6ac5ec8347c9815c770738509d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ced4a8a26d94c10b08bbca381d62d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:44.571910 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-43257624-8f7e-4504-84e1-5e884a27f650 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] 10.222.0.115 "GET /compute/v2.1/servers/b4dbc5ca-f31e-44e8-9573-6e79e891b989" status: 200 len: 1505 microversion: 2.1 time: 0.221914 Aug 02 10:55:44.572529 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 62/112] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:55:44 2022] GET /compute/v2.1/servers/b4dbc5ca-f31e-44e8-9573-6e79e891b989 => generated 1505 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:55:44.585746 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-388dfbb3-8da7-4461-a08c-a493f00a137b tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:44.586826 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-388dfbb3-8da7-4461-a08c-a493f00a137b tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] [instance: 3938932a-e778-4c0c-9ab0-78dc9082a48e] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:44.595516 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-388dfbb3-8da7-4461-a08c-a493f00a137b tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:44.595976 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-388dfbb3-8da7-4461-a08c-a493f00a137b tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:44.597630 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-388dfbb3-8da7-4461-a08c-a493f00a137b tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:44.598477 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-388dfbb3-8da7-4461-a08c-a493f00a137b tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:44.740187 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-bb60bfb4-0eb4-42a7-8a97-036fcf5a34cb tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "GET /compute/v2.1/servers/8a7b8f4c-0c11-406f-bed6-b4fd18e3c304/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.203925 Aug 02 10:55:44.740985 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 51/113] 10.222.0.115 () {58 vars in 1280 bytes} [Tue Aug 2 10:55:44 2022] GET /compute/v2.1/servers/8a7b8f4c-0c11-406f-bed6-b4fd18e3c304/os-interface => generated 285 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:55:44.978111 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-9cf6d554-94b7-4a55-8bde-fe9d326575b5 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:44.979215 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-9cf6d554-94b7-4a55-8bde-fe9d326575b5 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: b3a92fc5-5c44-48d1-8394-535687bb6ae3] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:44.995280 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-9cf6d554-94b7-4a55-8bde-fe9d326575b5 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:44.997649 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-9cf6d554-94b7-4a55-8bde-fe9d326575b5 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:44.999860 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-9cf6d554-94b7-4a55-8bde-fe9d326575b5 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:45.000551 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-9cf6d554-94b7-4a55-8bde-fe9d326575b5 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:45.013214 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-388dfbb3-8da7-4461-a08c-a493f00a137b tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f41f17f5154e01a699043edc350cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e92110a1545f1b84644b8971bb6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:45.022166 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-388dfbb3-8da7-4461-a08c-a493f00a137b tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] 10.222.0.115 "GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e" status: 200 len: 1365 microversion: 2.1 time: 0.440258 Aug 02 10:55:45.022741 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 63/114] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:55:44 2022] GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e => generated 1365 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:55:45.733600 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-9cf6d554-94b7-4a55-8bde-fe9d326575b5 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:45.743584 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-9cf6d554-94b7-4a55-8bde-fe9d326575b5 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:45.745469 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-9cf6d554-94b7-4a55-8bde-fe9d326575b5 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:45.748102 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-9cf6d554-94b7-4a55-8bde-fe9d326575b5 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3" status: 200 len: 1410 microversion: 2.20 time: 0.774123 Aug 02 10:55:45.751031 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 52/115] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 10:55:44 2022] GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3 => generated 1410 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:55:46.048966 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-26a85f4d-9db0-4997-b090-c5e75db17ac9 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:46.049579 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-26a85f4d-9db0-4997-b090-c5e75db17ac9 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] [instance: 3938932a-e778-4c0c-9ab0-78dc9082a48e] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:46.056129 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-26a85f4d-9db0-4997-b090-c5e75db17ac9 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:46.056574 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-26a85f4d-9db0-4997-b090-c5e75db17ac9 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:46.057327 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-26a85f4d-9db0-4997-b090-c5e75db17ac9 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:46.057757 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-26a85f4d-9db0-4997-b090-c5e75db17ac9 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:46.322306 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-26a85f4d-9db0-4997-b090-c5e75db17ac9 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f41f17f5154e01a699043edc350cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e92110a1545f1b84644b8971bb6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:46.331099 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-26a85f4d-9db0-4997-b090-c5e75db17ac9 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] 10.222.0.115 "GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e" status: 200 len: 1551 microversion: 2.1 time: 0.286044 Aug 02 10:55:46.345018 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 64/116] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:55:46 2022] GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e => generated 1551 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:55:46.365463 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-6b108649-7117-4bb2-b922-4915cb098c86 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:46.366255 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-6b108649-7117-4bb2-b922-4915cb098c86 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] [instance: 3938932a-e778-4c0c-9ab0-78dc9082a48e] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:46.374484 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-6b108649-7117-4bb2-b922-4915cb098c86 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:46.375119 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-6b108649-7117-4bb2-b922-4915cb098c86 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:46.376247 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-6b108649-7117-4bb2-b922-4915cb098c86 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:46.376808 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-6b108649-7117-4bb2-b922-4915cb098c86 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:46.485589 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-5532f8a3-5517-4bea-8b71-14b0f4311281 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6e679986-2360-40eb-a9b7-09deb710980d"}} {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:55:46.488587 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-5532f8a3-5517-4bea-8b71-14b0f4311281 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] [instance: b4dbc5ca-f31e-44e8-9573-6e79e891b989] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:46.499219 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-5532f8a3-5517-4bea-8b71-14b0f4311281 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:46.499219 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-5532f8a3-5517-4bea-8b71-14b0f4311281 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:46.499219 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-5532f8a3-5517-4bea-8b71-14b0f4311281 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:46.499219 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-5532f8a3-5517-4bea-8b71-14b0f4311281 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:46.524090 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-6b108649-7117-4bb2-b922-4915cb098c86 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] 10.222.0.115 "GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.166280 Aug 02 10:55:46.524677 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 53/117] 10.222.0.115 () {58 vars in 1280 bytes} [Tue Aug 2 10:55:46 2022] GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e/os-interface => generated 284 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:55:46.782634 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-f951ad9f-cb24-4179-8224-fc5328c7aeee tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:46.784327 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-f951ad9f-cb24-4179-8224-fc5328c7aeee tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: b3a92fc5-5c44-48d1-8394-535687bb6ae3] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:46.830947 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-f951ad9f-cb24-4179-8224-fc5328c7aeee tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:46.831950 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-f951ad9f-cb24-4179-8224-fc5328c7aeee tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:46.837643 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-f951ad9f-cb24-4179-8224-fc5328c7aeee tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:46.839435 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-f951ad9f-cb24-4179-8224-fc5328c7aeee tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:47.225846 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-f951ad9f-cb24-4179-8224-fc5328c7aeee tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:47.234528 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-f951ad9f-cb24-4179-8224-fc5328c7aeee tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:47.236489 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-f951ad9f-cb24-4179-8224-fc5328c7aeee tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:47.237188 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-f951ad9f-cb24-4179-8224-fc5328c7aeee tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3" status: 200 len: 1410 microversion: 2.20 time: 0.461942 Aug 02 10:55:47.246141 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 54/118] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 10:55:46 2022] GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3 => generated 1410 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:55:47.680637 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [req-058ef821-be70-4511-92bb-044df93541e0 req-6570828c-ce91-4eb5-ab5f-b5de0d7163d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a7b8f4c-0c11-406f-bed6-b4fd18e3c304", "tag": "a726c1ca-b762-4699-8bde-774b6f63a9dc"}]} {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:55:47.697051 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [req-058ef821-be70-4511-92bb-044df93541e0 req-6570828c-ce91-4eb5-ab5f-b5de0d7163d4 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:47.697501 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [req-058ef821-be70-4511-92bb-044df93541e0 req-6570828c-ce91-4eb5-ab5f-b5de0d7163d4 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:47.736445 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.compute.server_external_events [req-058ef821-be70-4511-92bb-044df93541e0 req-6570828c-ce91-4eb5-ab5f-b5de0d7163d4 service nova] Creating event network-changed:a726c1ca-b762-4699-8bde-774b6f63a9dc for instance 8a7b8f4c-0c11-406f-bed6-b4fd18e3c304 on hv-cinder-85031 Aug 02 10:55:47.757435 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [req-058ef821-be70-4511-92bb-044df93541e0 req-6570828c-ce91-4eb5-ab5f-b5de0d7163d4 service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080203 Aug 02 10:55:47.758040 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 55/119] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Aug 2 10:55:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:55:47.820005 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-5532f8a3-5517-4bea-8b71-14b0f4311281 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] 10.222.0.115 "POST /compute/v2.1/servers/b4dbc5ca-f31e-44e8-9573-6e79e891b989/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.338827 Aug 02 10:55:47.820892 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 65/120] 10.222.0.115 () {60 vars in 1328 bytes} [Tue Aug 2 10:55:46 2022] POST /compute/v2.1/servers/b4dbc5ca-f31e-44e8-9573-6e79e891b989/os-volume_attachments => generated 194 bytes in 1341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:55:48.265346 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-cf15de98-a27f-415d-849d-ad8f4632bf13 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:48.276869 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-cf15de98-a27f-415d-849d-ad8f4632bf13 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: b3a92fc5-5c44-48d1-8394-535687bb6ae3] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:48.292274 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-cf15de98-a27f-415d-849d-ad8f4632bf13 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:48.293414 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-cf15de98-a27f-415d-849d-ad8f4632bf13 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:48.294418 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-cf15de98-a27f-415d-849d-ad8f4632bf13 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:48.295103 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-cf15de98-a27f-415d-849d-ad8f4632bf13 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:48.712989 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-cf15de98-a27f-415d-849d-ad8f4632bf13 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:48.728097 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-cf15de98-a27f-415d-849d-ad8f4632bf13 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:48.729472 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-cf15de98-a27f-415d-849d-ad8f4632bf13 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:48.734377 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-cf15de98-a27f-415d-849d-ad8f4632bf13 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3" status: 200 len: 1603 microversion: 2.20 time: 0.471779 Aug 02 10:55:48.737072 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 56/121] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 10:55:48 2022] GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3 => generated 1603 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:55:48.765666 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-70b914aa-6f46-4938-b871-a42feb2ff70c tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:48.766257 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-70b914aa-6f46-4938-b871-a42feb2ff70c tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: b3a92fc5-5c44-48d1-8394-535687bb6ae3] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:48.775019 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-70b914aa-6f46-4938-b871-a42feb2ff70c tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:48.775501 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-70b914aa-6f46-4938-b871-a42feb2ff70c tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:48.776374 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-70b914aa-6f46-4938-b871-a42feb2ff70c tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:48.779216 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-70b914aa-6f46-4938-b871-a42feb2ff70c tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:48.896192 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-70b914aa-6f46-4938-b871-a42feb2ff70c tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.136833 Aug 02 10:55:48.897629 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 66/122] 10.222.0.115 () {60 vars in 1321 bytes} [Tue Aug 2 10:55:48 2022] GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3/os-interface => generated 285 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:55:49.813471 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [req-447ab154-a6b7-49e8-8849-279297c36bcd req-0e136da2-39f5-4d33-bd57-e38299e9017b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3938932a-e778-4c0c-9ab0-78dc9082a48e", "tag": "9f11ec7a-3435-4709-afef-46942fe71fcf"}]} {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:55:49.827286 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [req-447ab154-a6b7-49e8-8849-279297c36bcd req-0e136da2-39f5-4d33-bd57-e38299e9017b service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:49.828019 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [req-447ab154-a6b7-49e8-8849-279297c36bcd req-0e136da2-39f5-4d33-bd57-e38299e9017b service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:49.844191 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.compute.server_external_events [req-447ab154-a6b7-49e8-8849-279297c36bcd req-0e136da2-39f5-4d33-bd57-e38299e9017b service nova] Creating event network-changed:9f11ec7a-3435-4709-afef-46942fe71fcf for instance 3938932a-e778-4c0c-9ab0-78dc9082a48e on hv-cinder-85031 Aug 02 10:55:49.850829 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [req-447ab154-a6b7-49e8-8849-279297c36bcd req-0e136da2-39f5-4d33-bd57-e38299e9017b service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044031 Aug 02 10:55:49.851753 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 57/123] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Aug 2 10:55:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:55:51.885013 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [req-9d2a5edf-4f39-47f1-a52e-59b8c42df2eb req-db75fada-bdc9-479b-81ee-f688b03646c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3a92fc5-5c44-48d1-8394-535687bb6ae3", "tag": "03045dd7-30b5-4c87-bcb8-828046dbcd75"}]} {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:55:51.915561 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [req-9d2a5edf-4f39-47f1-a52e-59b8c42df2eb req-db75fada-bdc9-479b-81ee-f688b03646c8 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:51.915561 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [req-9d2a5edf-4f39-47f1-a52e-59b8c42df2eb req-db75fada-bdc9-479b-81ee-f688b03646c8 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:51.950753 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.compute.server_external_events [req-9d2a5edf-4f39-47f1-a52e-59b8c42df2eb req-db75fada-bdc9-479b-81ee-f688b03646c8 service nova] Creating event network-changed:03045dd7-30b5-4c87-bcb8-828046dbcd75 for instance b3a92fc5-5c44-48d1-8394-535687bb6ae3 on hv-cinder-85031 Aug 02 10:55:51.960856 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [req-9d2a5edf-4f39-47f1-a52e-59b8c42df2eb req-db75fada-bdc9-479b-81ee-f688b03646c8 service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083788 Aug 02 10:55:51.967701 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 67/124] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Aug 2 10:55:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:55:58.138943 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG dbcounter [-] [129952] Writing DB stats nova_cell0:SELECT=2 {{(pid=129952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:55:58.143286 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-175fc9c7-99a8-42f5-9f57-08b63cc6e3f5 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:58.143876 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-175fc9c7-99a8-42f5-9f57-08b63cc6e3f5 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] [instance: b4dbc5ca-f31e-44e8-9573-6e79e891b989] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:58.145662 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG dbcounter [-] [129952] Writing DB stats nova_api:SELECT=75 {{(pid=129952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:55:58.150698 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-175fc9c7-99a8-42f5-9f57-08b63cc6e3f5 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:58.151184 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-175fc9c7-99a8-42f5-9f57-08b63cc6e3f5 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:58.151957 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-175fc9c7-99a8-42f5-9f57-08b63cc6e3f5 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:58.152638 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-175fc9c7-99a8-42f5-9f57-08b63cc6e3f5 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:58.182673 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-175fc9c7-99a8-42f5-9f57-08b63cc6e3f5 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] [instance: b4dbc5ca-f31e-44e8-9573-6e79e891b989] Going to try to terminate instance {{(pid=129952) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 10:55:58.544820 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-175fc9c7-99a8-42f5-9f57-08b63cc6e3f5 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] 10.222.0.115 "DELETE /compute/v2.1/servers/b4dbc5ca-f31e-44e8-9573-6e79e891b989" status: 204 len: 0 microversion: 2.1 time: 0.406588 Aug 02 10:55:58.547037 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 58/125] 10.222.0.115 () {58 vars in 1244 bytes} [Tue Aug 2 10:55:58 2022] DELETE /compute/v2.1/servers/b4dbc5ca-f31e-44e8-9573-6e79e891b989 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 10:55:58.554775 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-a1539c3d-89cc-41b8-bcaa-86e4d46dbd8d tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:58.556011 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-a1539c3d-89cc-41b8-bcaa-86e4d46dbd8d tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] [instance: b4dbc5ca-f31e-44e8-9573-6e79e891b989] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:58.562808 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-a1539c3d-89cc-41b8-bcaa-86e4d46dbd8d tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:58.563513 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-a1539c3d-89cc-41b8-bcaa-86e4d46dbd8d tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:58.564327 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-a1539c3d-89cc-41b8-bcaa-86e4d46dbd8d tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:58.565803 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-a1539c3d-89cc-41b8-bcaa-86e4d46dbd8d tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:58.716144 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-a1539c3d-89cc-41b8-bcaa-86e4d46dbd8d tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822e6ac5ec8347c9815c770738509d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ced4a8a26d94c10b08bbca381d62d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:58.724140 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-a1539c3d-89cc-41b8-bcaa-86e4d46dbd8d tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] 10.222.0.115 "GET /compute/v2.1/servers/b4dbc5ca-f31e-44e8-9573-6e79e891b989" status: 200 len: 1557 microversion: 2.1 time: 0.174220 Aug 02 10:55:58.724847 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 68/126] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:55:58 2022] GET /compute/v2.1/servers/b4dbc5ca-f31e-44e8-9573-6e79e891b989 => generated 1557 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:55:59.746881 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-52dc7793-d486-4e36-8788-e7b8ccfa9247 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:55:59.747990 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-52dc7793-d486-4e36-8788-e7b8ccfa9247 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] [instance: b4dbc5ca-f31e-44e8-9573-6e79e891b989] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:55:59.754763 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-52dc7793-d486-4e36-8788-e7b8ccfa9247 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:59.755254 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-52dc7793-d486-4e36-8788-e7b8ccfa9247 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:59.756129 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-52dc7793-d486-4e36-8788-e7b8ccfa9247 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:55:59.756571 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-52dc7793-d486-4e36-8788-e7b8ccfa9247 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:55:59.916359 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-52dc7793-d486-4e36-8788-e7b8ccfa9247 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822e6ac5ec8347c9815c770738509d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ced4a8a26d94c10b08bbca381d62d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:55:59.926744 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-52dc7793-d486-4e36-8788-e7b8ccfa9247 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] 10.222.0.115 "GET /compute/v2.1/servers/b4dbc5ca-f31e-44e8-9573-6e79e891b989" status: 200 len: 1557 microversion: 2.1 time: 0.183965 Aug 02 10:55:59.926888 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 59/127] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:55:59 2022] GET /compute/v2.1/servers/b4dbc5ca-f31e-44e8-9573-6e79e891b989 => generated 1557 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:56:00.949395 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-86deb983-3268-481b-a662-fd0667805140 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:56:00.951134 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-86deb983-3268-481b-a662-fd0667805140 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] [instance: b4dbc5ca-f31e-44e8-9573-6e79e891b989] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:56:00.963511 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-86deb983-3268-481b-a662-fd0667805140 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:00.963977 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-86deb983-3268-481b-a662-fd0667805140 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:00.965492 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-86deb983-3268-481b-a662-fd0667805140 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:00.970955 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-86deb983-3268-481b-a662-fd0667805140 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:01.202910 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-86deb983-3268-481b-a662-fd0667805140 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822e6ac5ec8347c9815c770738509d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ced4a8a26d94c10b08bbca381d62d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:56:01.211608 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-86deb983-3268-481b-a662-fd0667805140 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] 10.222.0.115 "GET /compute/v2.1/servers/b4dbc5ca-f31e-44e8-9573-6e79e891b989" status: 200 len: 1557 microversion: 2.1 time: 0.267231 Aug 02 10:56:01.223127 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 69/128] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:56:00 2022] GET /compute/v2.1/servers/b4dbc5ca-f31e-44e8-9573-6e79e891b989 => generated 1557 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:56:02.101210 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [req-553ad24e-f2d5-4421-9ed7-a6004cdc4299 req-b19f0c6a-fd9e-4746-ab56-f761b902a3ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4dbc5ca-f31e-44e8-9573-6e79e891b989", "name": "network-vif-deleted", "tag": "86f8bd72-e159-4310-b36a-1444e34459c4"}]} {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:56:02.113221 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [req-553ad24e-f2d5-4421-9ed7-a6004cdc4299 req-b19f0c6a-fd9e-4746-ab56-f761b902a3ea service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:02.113882 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [req-553ad24e-f2d5-4421-9ed7-a6004cdc4299 req-b19f0c6a-fd9e-4746-ab56-f761b902a3ea service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:02.131027 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.compute.server_external_events [req-553ad24e-f2d5-4421-9ed7-a6004cdc4299 req-b19f0c6a-fd9e-4746-ab56-f761b902a3ea service nova] Creating event network-vif-deleted:86f8bd72-e159-4310-b36a-1444e34459c4 for instance b4dbc5ca-f31e-44e8-9573-6e79e891b989 on hv-cinder-85031 Aug 02 10:56:02.138524 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [req-553ad24e-f2d5-4421-9ed7-a6004cdc4299 req-b19f0c6a-fd9e-4746-ab56-f761b902a3ea service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046583 Aug 02 10:56:02.140129 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 60/129] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Aug 2 10:56:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:56:02.234731 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-5c5130ac-4d5d-4a16-9504-c9cab87703b2 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:56:02.235665 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-5c5130ac-4d5d-4a16-9504-c9cab87703b2 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] [instance: b4dbc5ca-f31e-44e8-9573-6e79e891b989] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:56:02.242136 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-5c5130ac-4d5d-4a16-9504-c9cab87703b2 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:02.243986 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-5c5130ac-4d5d-4a16-9504-c9cab87703b2 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:02.244820 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-5c5130ac-4d5d-4a16-9504-c9cab87703b2 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:02.247687 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-5c5130ac-4d5d-4a16-9504-c9cab87703b2 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:02.342412 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-5c5130ac-4d5d-4a16-9504-c9cab87703b2 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822e6ac5ec8347c9815c770738509d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ced4a8a26d94c10b08bbca381d62d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:56:02.351089 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-5c5130ac-4d5d-4a16-9504-c9cab87703b2 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] 10.222.0.115 "GET /compute/v2.1/servers/b4dbc5ca-f31e-44e8-9573-6e79e891b989" status: 200 len: 1515 microversion: 2.1 time: 0.120847 Aug 02 10:56:02.351437 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 70/130] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:56:02 2022] GET /compute/v2.1/servers/b4dbc5ca-f31e-44e8-9573-6e79e891b989 => generated 1515 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:56:03.376471 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-f1c8c4f4-3eb1-480f-b1cd-7dafc9ce8b8b tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:56:03.377173 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-f1c8c4f4-3eb1-480f-b1cd-7dafc9ce8b8b tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] [instance: b4dbc5ca-f31e-44e8-9573-6e79e891b989] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:56:03.383573 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-f1c8c4f4-3eb1-480f-b1cd-7dafc9ce8b8b tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:03.384018 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-f1c8c4f4-3eb1-480f-b1cd-7dafc9ce8b8b tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:03.384788 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-f1c8c4f4-3eb1-480f-b1cd-7dafc9ce8b8b tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:03.385407 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-f1c8c4f4-3eb1-480f-b1cd-7dafc9ce8b8b tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:03.452693 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-f1c8c4f4-3eb1-480f-b1cd-7dafc9ce8b8b tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:03.453339 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-f1c8c4f4-3eb1-480f-b1cd-7dafc9ce8b8b tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:03.454066 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.objects.instance [None req-f1c8c4f4-3eb1-480f-b1cd-7dafc9ce8b8b tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lazy-loading 'fault' on Instance uuid b4dbc5ca-f31e-44e8-9573-6e79e891b989 {{(pid=129952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 10:56:03.536930 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-f1c8c4f4-3eb1-480f-b1cd-7dafc9ce8b8b tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822e6ac5ec8347c9815c770738509d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ced4a8a26d94c10b08bbca381d62d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:56:03.548451 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-f1c8c4f4-3eb1-480f-b1cd-7dafc9ce8b8b tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] 10.222.0.115 "GET /compute/v2.1/servers/b4dbc5ca-f31e-44e8-9573-6e79e891b989" status: 200 len: 1355 microversion: 2.1 time: 0.177402 Aug 02 10:56:03.553977 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 61/131] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:56:03 2022] GET /compute/v2.1/servers/b4dbc5ca-f31e-44e8-9573-6e79e891b989 => generated 1355 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:56:04.583605 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-01713169-d8b9-46b8-9b02-b90759b19f03 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:56:04.584203 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-01713169-d8b9-46b8-9b02-b90759b19f03 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] [instance: b4dbc5ca-f31e-44e8-9573-6e79e891b989] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:56:04.592334 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-01713169-d8b9-46b8-9b02-b90759b19f03 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:04.593029 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-01713169-d8b9-46b8-9b02-b90759b19f03 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:04.595445 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-01713169-d8b9-46b8-9b02-b90759b19f03 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:04.596195 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-01713169-d8b9-46b8-9b02-b90759b19f03 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:04.613416 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.wsgi [None req-01713169-d8b9-46b8-9b02-b90759b19f03 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] HTTP exception thrown: Instance b4dbc5ca-f31e-44e8-9573-6e79e891b989 could not be found. Aug 02 10:56:04.618885 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-01713169-d8b9-46b8-9b02-b90759b19f03 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Request method failure captured: Aug 02 10:56:04.618885 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: request: GET /compute/v2.1/servers/b4dbc5ca-f31e-44e8-9573-6e79e891b989 HTTP/1.1 Aug 02 10:56:04.618885 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Accept: application/json Aug 02 10:56:04.618885 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Accept-Encoding: identity Aug 02 10:56:04.618885 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Connection: close Aug 02 10:56:04.618885 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Content-Length: 0 Aug 02 10:56:04.618885 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Content-Type: application/json Aug 02 10:56:04.618885 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Host: 10.222.0.115 Aug 02 10:56:04.618885 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Openstack-System-Scope: None Aug 02 10:56:04.618885 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: User-Agent: python-urllib3/1.26.10 Aug 02 10:56:04.618885 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Auth-Token: gAAAAABi6QKK6tq17asI-d8oKBZF7ANOBAN6ZpAFqA-UAbBMj4L2pB2h12eIqtoSl9Lujzng5MfVIds--vxZjRfet54y6HV6HzRxvlA7QobCx5E2laxdne0-CV8unzJQa2PEeUPQaFDLMz8ZSyUwNb_pP1IRteQhzPwGHc0BvRGQYBmx5wQuhr8 Aug 02 10:56:04.618885 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Domain-Id: None Aug 02 10:56:04.618885 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Domain-Name: None Aug 02 10:56:04.618885 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Identity-Status: Confirmed Aug 02 10:56:04.618885 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Is-Admin-Project: True Aug 02 10:56:04.618885 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Project-Domain-Id: default Aug 02 10:56:04.618885 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Project-Domain-Name: Default Aug 02 10:56:04.618885 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Project-Id: 5ced4a8a26d94c10b08bbca381d62d34 Aug 02 10:56:04.618885 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Project-Name: tempest-DeleteServersTestJSON-1083452059 Aug 02 10:56:04.618885 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Role: reader,member Aug 02 10:56:04.618885 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Roles: reader,member Aug 02 10:56:04.620488 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/5ced4a8a26d94c10b08bbca381d62d34"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2/5ced4a8a26d94c10b08bbca381d62d34"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/5ced4a8a26d94c10b08bbca381d62d34"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.115:8080", "publicURL": "http://10.222.0.115:8080/v1/AUTH_5ced4a8a26d94c10b08bbca381d62d34"}]}] Aug 02 10:56:04.620488 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Tenant: tempest-DeleteServersTestJSON-1083452059 Aug 02 10:56:04.620488 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Tenant-Id: 5ced4a8a26d94c10b08bbca381d62d34 Aug 02 10:56:04.620488 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Tenant-Name: tempest-DeleteServersTestJSON-1083452059 Aug 02 10:56:04.620488 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User: tempest-DeleteServersTestJSON-1083452059-project Aug 02 10:56:04.620488 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User-Domain-Id: default Aug 02 10:56:04.620488 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User-Domain-Name: Default Aug 02 10:56:04.620488 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User-Id: 822e6ac5ec8347c9815c770738509d30 Aug 02 10:56:04.620488 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User-Name: tempest-DeleteServersTestJSON-1083452059-project Aug 02 10:56:04.620488 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: method: > Aug 02 10:56:04.620488 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: exception: Instance b4dbc5ca-f31e-44e8-9573-6e79e891b989 could not be found. Aug 02 10:56:04.620488 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: action_args: {'id': 'b4dbc5ca-f31e-44e8-9573-6e79e891b989'} Aug 02 10:56:04.621281 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:56:04.621281 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:56:04.621281 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 10:56:04.621281 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 10:56:04.621281 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 10:56:04.621281 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 10:56:04.621281 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 10:56:04.621281 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 10:56:04.621281 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 10:56:04.621281 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 10:56:04.621281 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4dbc5ca-f31e-44e8-9573-6e79e891b989 could not be found. Aug 02 10:56:04.621281 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 10:56:04.621281 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:56:04.621281 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 10:56:04.621281 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:56:04.621281 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:56:04.621281 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:56:04.621281 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:56:04.621281 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:56:04.621281 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:56:04.623111 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:56:04.623111 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 10:56:04.623111 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 10:56:04.623111 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 10:56:04.623111 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 10:56:04.623111 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 10:56:04.623111 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 10:56:04.623111 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4dbc5ca-f31e-44e8-9573-6e79e891b989 could not be found. Aug 02 10:56:04.623111 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 10:56:04.623111 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:56:04.623111 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 10:56:04.623111 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:56:04.623111 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:56:04.623111 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:56:04.623111 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:56:04.623111 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:56:04.623111 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4dbc5ca-f31e-44e8-9573-6e79e891b989 could not be found. Aug 02 10:56:04.623111 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 10:56:04.625433 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-01713169-d8b9-46b8-9b02-b90759b19f03 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Returning 404 to user: Instance b4dbc5ca-f31e-44e8-9573-6e79e891b989 could not be found. {{(pid=129953) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:56:04.626463 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-01713169-d8b9-46b8-9b02-b90759b19f03 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] 10.222.0.115 "GET /compute/v2.1/servers/b4dbc5ca-f31e-44e8-9573-6e79e891b989" status: 404 len: 111 microversion: 2.1 time: 0.047212 Aug 02 10:56:04.627026 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 71/132] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:56:04 2022] GET /compute/v2.1/servers/b4dbc5ca-f31e-44e8-9573-6e79e891b989 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 10:56:04.796455 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-8267d12c-2369-49c7-b6a5-09119610a242 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:56:04.798604 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-8267d12c-2369-49c7-b6a5-09119610a242 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] [instance: b4dbc5ca-f31e-44e8-9573-6e79e891b989] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:56:04.804727 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-8267d12c-2369-49c7-b6a5-09119610a242 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:04.805185 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-8267d12c-2369-49c7-b6a5-09119610a242 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:04.805960 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-8267d12c-2369-49c7-b6a5-09119610a242 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:04.806388 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-8267d12c-2369-49c7-b6a5-09119610a242 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:04.822026 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.wsgi [None req-8267d12c-2369-49c7-b6a5-09119610a242 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] HTTP exception thrown: Instance b4dbc5ca-f31e-44e8-9573-6e79e891b989 could not be found. Aug 02 10:56:04.826434 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-8267d12c-2369-49c7-b6a5-09119610a242 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Request method failure captured: Aug 02 10:56:04.826434 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: request: GET /compute/v2.1/servers/b4dbc5ca-f31e-44e8-9573-6e79e891b989/os-volume_attachments HTTP/1.1 Aug 02 10:56:04.826434 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Accept: application/json Aug 02 10:56:04.826434 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Accept-Encoding: identity Aug 02 10:56:04.826434 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Connection: close Aug 02 10:56:04.826434 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Content-Length: 0 Aug 02 10:56:04.826434 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Content-Type: application/json Aug 02 10:56:04.826434 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Host: 10.222.0.115 Aug 02 10:56:04.826434 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Openstack-System-Scope: None Aug 02 10:56:04.826434 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: User-Agent: python-urllib3/1.26.10 Aug 02 10:56:04.826434 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Auth-Token: gAAAAABi6QKK6tq17asI-d8oKBZF7ANOBAN6ZpAFqA-UAbBMj4L2pB2h12eIqtoSl9Lujzng5MfVIds--vxZjRfet54y6HV6HzRxvlA7QobCx5E2laxdne0-CV8unzJQa2PEeUPQaFDLMz8ZSyUwNb_pP1IRteQhzPwGHc0BvRGQYBmx5wQuhr8 Aug 02 10:56:04.826434 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Domain-Id: None Aug 02 10:56:04.826434 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Domain-Name: None Aug 02 10:56:04.826434 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Identity-Status: Confirmed Aug 02 10:56:04.826434 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Is-Admin-Project: True Aug 02 10:56:04.826434 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Project-Domain-Id: default Aug 02 10:56:04.826434 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Project-Domain-Name: Default Aug 02 10:56:04.826434 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Project-Id: 5ced4a8a26d94c10b08bbca381d62d34 Aug 02 10:56:04.826434 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Project-Name: tempest-DeleteServersTestJSON-1083452059 Aug 02 10:56:04.826434 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Role: reader,member Aug 02 10:56:04.826434 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Roles: reader,member Aug 02 10:56:04.828145 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/5ced4a8a26d94c10b08bbca381d62d34"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2/5ced4a8a26d94c10b08bbca381d62d34"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/5ced4a8a26d94c10b08bbca381d62d34"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.115:8080", "publicURL": "http://10.222.0.115:8080/v1/AUTH_5ced4a8a26d94c10b08bbca381d62d34"}]}] Aug 02 10:56:04.828145 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Tenant: tempest-DeleteServersTestJSON-1083452059 Aug 02 10:56:04.828145 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Tenant-Id: 5ced4a8a26d94c10b08bbca381d62d34 Aug 02 10:56:04.828145 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Tenant-Name: tempest-DeleteServersTestJSON-1083452059 Aug 02 10:56:04.828145 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User: tempest-DeleteServersTestJSON-1083452059-project Aug 02 10:56:04.828145 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User-Domain-Id: default Aug 02 10:56:04.828145 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User-Domain-Name: Default Aug 02 10:56:04.828145 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User-Id: 822e6ac5ec8347c9815c770738509d30 Aug 02 10:56:04.828145 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User-Name: tempest-DeleteServersTestJSON-1083452059-project Aug 02 10:56:04.828145 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: method: > Aug 02 10:56:04.828145 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: exception: Instance b4dbc5ca-f31e-44e8-9573-6e79e891b989 could not be found. Aug 02 10:56:04.828145 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: action_args: {'server_id': 'b4dbc5ca-f31e-44e8-9573-6e79e891b989'} Aug 02 10:56:04.829004 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:56:04.829004 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:56:04.829004 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 10:56:04.829004 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 10:56:04.829004 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 10:56:04.829004 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 10:56:04.829004 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 10:56:04.829004 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 10:56:04.829004 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 10:56:04.829004 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 10:56:04.829004 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4dbc5ca-f31e-44e8-9573-6e79e891b989 could not be found. Aug 02 10:56:04.829004 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 10:56:04.829004 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:56:04.829004 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 10:56:04.829004 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:56:04.829004 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:56:04.829004 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:56:04.829004 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:56:04.829004 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:56:04.829004 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:56:04.830825 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:56:04.830825 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 02 10:56:04.830825 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 10:56:04.830825 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 02 10:56:04.830825 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 10:56:04.830825 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 02 10:56:04.830825 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 02 10:56:04.830825 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 10:56:04.830825 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 10:56:04.830825 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4dbc5ca-f31e-44e8-9573-6e79e891b989 could not be found. Aug 02 10:56:04.830825 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 10:56:04.830825 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:56:04.830825 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 10:56:04.830825 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:56:04.830825 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:56:04.830825 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:56:04.830825 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:56:04.830825 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:56:04.830825 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4dbc5ca-f31e-44e8-9573-6e79e891b989 could not be found. Aug 02 10:56:04.830825 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 10:56:04.832275 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-8267d12c-2369-49c7-b6a5-09119610a242 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Returning 404 to user: Instance b4dbc5ca-f31e-44e8-9573-6e79e891b989 could not be found. {{(pid=129952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:56:04.832275 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-8267d12c-2369-49c7-b6a5-09119610a242 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] 10.222.0.115 "GET /compute/v2.1/servers/b4dbc5ca-f31e-44e8-9573-6e79e891b989/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.036936 Aug 02 10:56:04.832543 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 62/133] 10.222.0.115 () {58 vars in 1307 bytes} [Tue Aug 2 10:56:04 2022] GET /compute/v2.1/servers/b4dbc5ca-f31e-44e8-9573-6e79e891b989/os-volume_attachments => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 10:56:06.520392 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-687d9f87-36ec-4301-93f8-ccfcdd341a44 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:56:06.521085 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-687d9f87-36ec-4301-93f8-ccfcdd341a44 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] [instance: b4dbc5ca-f31e-44e8-9573-6e79e891b989] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:56:06.528773 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-687d9f87-36ec-4301-93f8-ccfcdd341a44 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:06.529306 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-687d9f87-36ec-4301-93f8-ccfcdd341a44 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:06.530311 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-687d9f87-36ec-4301-93f8-ccfcdd341a44 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:06.530811 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-687d9f87-36ec-4301-93f8-ccfcdd341a44 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:06.546468 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.wsgi [None req-687d9f87-36ec-4301-93f8-ccfcdd341a44 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] HTTP exception thrown: Instance b4dbc5ca-f31e-44e8-9573-6e79e891b989 could not be found. Aug 02 10:56:06.548208 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-687d9f87-36ec-4301-93f8-ccfcdd341a44 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Request method failure captured: Aug 02 10:56:06.548208 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: request: DELETE /compute/v2.1/servers/b4dbc5ca-f31e-44e8-9573-6e79e891b989 HTTP/1.1 Aug 02 10:56:06.548208 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Accept: application/json Aug 02 10:56:06.548208 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Accept-Encoding: identity Aug 02 10:56:06.548208 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Connection: close Aug 02 10:56:06.548208 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Content-Length: 0 Aug 02 10:56:06.548208 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Content-Type: application/json Aug 02 10:56:06.548208 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Host: 10.222.0.115 Aug 02 10:56:06.548208 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Openstack-System-Scope: None Aug 02 10:56:06.548208 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: User-Agent: python-urllib3/1.26.10 Aug 02 10:56:06.548208 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Auth-Token: gAAAAABi6QKK6tq17asI-d8oKBZF7ANOBAN6ZpAFqA-UAbBMj4L2pB2h12eIqtoSl9Lujzng5MfVIds--vxZjRfet54y6HV6HzRxvlA7QobCx5E2laxdne0-CV8unzJQa2PEeUPQaFDLMz8ZSyUwNb_pP1IRteQhzPwGHc0BvRGQYBmx5wQuhr8 Aug 02 10:56:06.548208 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Domain-Id: None Aug 02 10:56:06.548208 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Domain-Name: None Aug 02 10:56:06.548208 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Identity-Status: Confirmed Aug 02 10:56:06.548208 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Is-Admin-Project: True Aug 02 10:56:06.548208 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Project-Domain-Id: default Aug 02 10:56:06.548208 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Project-Domain-Name: Default Aug 02 10:56:06.548208 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Project-Id: 5ced4a8a26d94c10b08bbca381d62d34 Aug 02 10:56:06.548208 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Project-Name: tempest-DeleteServersTestJSON-1083452059 Aug 02 10:56:06.548208 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Role: reader,member Aug 02 10:56:06.548208 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Roles: reader,member Aug 02 10:56:06.550271 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/5ced4a8a26d94c10b08bbca381d62d34"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2/5ced4a8a26d94c10b08bbca381d62d34"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/5ced4a8a26d94c10b08bbca381d62d34"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.115:8080", "publicURL": "http://10.222.0.115:8080/v1/AUTH_5ced4a8a26d94c10b08bbca381d62d34"}]}] Aug 02 10:56:06.550271 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Tenant: tempest-DeleteServersTestJSON-1083452059 Aug 02 10:56:06.550271 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Tenant-Id: 5ced4a8a26d94c10b08bbca381d62d34 Aug 02 10:56:06.550271 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Tenant-Name: tempest-DeleteServersTestJSON-1083452059 Aug 02 10:56:06.550271 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User: tempest-DeleteServersTestJSON-1083452059-project Aug 02 10:56:06.550271 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User-Domain-Id: default Aug 02 10:56:06.550271 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User-Domain-Name: Default Aug 02 10:56:06.550271 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User-Id: 822e6ac5ec8347c9815c770738509d30 Aug 02 10:56:06.550271 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User-Name: tempest-DeleteServersTestJSON-1083452059-project Aug 02 10:56:06.550271 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: method: > Aug 02 10:56:06.550271 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: exception: Instance b4dbc5ca-f31e-44e8-9573-6e79e891b989 could not be found. Aug 02 10:56:06.550271 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: action_args: {'id': 'b4dbc5ca-f31e-44e8-9573-6e79e891b989'} Aug 02 10:56:06.552247 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:56:06.552247 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:56:06.552247 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 10:56:06.552247 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 10:56:06.552247 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 10:56:06.552247 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 10:56:06.552247 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 10:56:06.552247 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 10:56:06.552247 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 10:56:06.552247 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 10:56:06.552247 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4dbc5ca-f31e-44e8-9573-6e79e891b989 could not be found. Aug 02 10:56:06.552247 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 10:56:06.552247 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:56:06.552247 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 10:56:06.552247 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:56:06.552247 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:56:06.552247 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:56:06.552247 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:56:06.552247 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:56:06.552247 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:56:06.564370 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:56:06.564370 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 10:56:06.564370 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 10:56:06.564370 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 10:56:06.564370 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 10:56:06.564370 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 10:56:06.564370 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 10:56:06.564370 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 10:56:06.564370 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 10:56:06.564370 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4dbc5ca-f31e-44e8-9573-6e79e891b989 could not be found. Aug 02 10:56:06.564370 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 10:56:06.564370 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:56:06.564370 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 10:56:06.564370 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:56:06.564370 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:56:06.564370 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:56:06.564370 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:56:06.564370 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:56:06.564370 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4dbc5ca-f31e-44e8-9573-6e79e891b989 could not be found. Aug 02 10:56:06.564370 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 10:56:06.566003 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-687d9f87-36ec-4301-93f8-ccfcdd341a44 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Returning 404 to user: Instance b4dbc5ca-f31e-44e8-9573-6e79e891b989 could not be found. {{(pid=129953) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:56:06.566003 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-687d9f87-36ec-4301-93f8-ccfcdd341a44 tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] 10.222.0.115 "DELETE /compute/v2.1/servers/b4dbc5ca-f31e-44e8-9573-6e79e891b989" status: 404 len: 111 microversion: 2.1 time: 0.033256 Aug 02 10:56:06.566003 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 72/134] 10.222.0.115 () {58 vars in 1244 bytes} [Tue Aug 2 10:56:06 2022] DELETE /compute/v2.1/servers/b4dbc5ca-f31e-44e8-9573-6e79e891b989 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 02 10:56:06.567245 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-b73186f3-9594-4b54-9118-372bd78bf46a tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:56:06.567935 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-b73186f3-9594-4b54-9118-372bd78bf46a tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] [instance: b4dbc5ca-f31e-44e8-9573-6e79e891b989] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:56:06.583292 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-b73186f3-9594-4b54-9118-372bd78bf46a tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:06.583985 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-b73186f3-9594-4b54-9118-372bd78bf46a tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:06.586182 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-b73186f3-9594-4b54-9118-372bd78bf46a tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:06.596951 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-b73186f3-9594-4b54-9118-372bd78bf46a tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:06.635735 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.wsgi [None req-b73186f3-9594-4b54-9118-372bd78bf46a tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] HTTP exception thrown: Instance b4dbc5ca-f31e-44e8-9573-6e79e891b989 could not be found. Aug 02 10:56:06.638005 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-b73186f3-9594-4b54-9118-372bd78bf46a tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Request method failure captured: Aug 02 10:56:06.638005 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: request: GET /compute/v2.1/servers/b4dbc5ca-f31e-44e8-9573-6e79e891b989 HTTP/1.1 Aug 02 10:56:06.638005 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Accept: application/json Aug 02 10:56:06.638005 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Accept-Encoding: identity Aug 02 10:56:06.638005 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Connection: close Aug 02 10:56:06.638005 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Content-Length: 0 Aug 02 10:56:06.638005 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Content-Type: application/json Aug 02 10:56:06.638005 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Host: 10.222.0.115 Aug 02 10:56:06.638005 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Openstack-System-Scope: None Aug 02 10:56:06.638005 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: User-Agent: python-urllib3/1.26.10 Aug 02 10:56:06.638005 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Auth-Token: gAAAAABi6QKK6tq17asI-d8oKBZF7ANOBAN6ZpAFqA-UAbBMj4L2pB2h12eIqtoSl9Lujzng5MfVIds--vxZjRfet54y6HV6HzRxvlA7QobCx5E2laxdne0-CV8unzJQa2PEeUPQaFDLMz8ZSyUwNb_pP1IRteQhzPwGHc0BvRGQYBmx5wQuhr8 Aug 02 10:56:06.638005 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Domain-Id: None Aug 02 10:56:06.638005 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Domain-Name: None Aug 02 10:56:06.638005 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Identity-Status: Confirmed Aug 02 10:56:06.638005 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Is-Admin-Project: True Aug 02 10:56:06.638005 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Project-Domain-Id: default Aug 02 10:56:06.638005 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Project-Domain-Name: Default Aug 02 10:56:06.638005 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Project-Id: 5ced4a8a26d94c10b08bbca381d62d34 Aug 02 10:56:06.638005 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Project-Name: tempest-DeleteServersTestJSON-1083452059 Aug 02 10:56:06.638005 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Role: reader,member Aug 02 10:56:06.638005 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Roles: reader,member Aug 02 10:56:06.639855 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/5ced4a8a26d94c10b08bbca381d62d34"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2/5ced4a8a26d94c10b08bbca381d62d34"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/5ced4a8a26d94c10b08bbca381d62d34"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.115:8080", "publicURL": "http://10.222.0.115:8080/v1/AUTH_5ced4a8a26d94c10b08bbca381d62d34"}]}] Aug 02 10:56:06.639855 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Tenant: tempest-DeleteServersTestJSON-1083452059 Aug 02 10:56:06.639855 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Tenant-Id: 5ced4a8a26d94c10b08bbca381d62d34 Aug 02 10:56:06.639855 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Tenant-Name: tempest-DeleteServersTestJSON-1083452059 Aug 02 10:56:06.639855 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User: tempest-DeleteServersTestJSON-1083452059-project Aug 02 10:56:06.639855 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User-Domain-Id: default Aug 02 10:56:06.639855 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User-Domain-Name: Default Aug 02 10:56:06.639855 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User-Id: 822e6ac5ec8347c9815c770738509d30 Aug 02 10:56:06.639855 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User-Name: tempest-DeleteServersTestJSON-1083452059-project Aug 02 10:56:06.639855 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: method: > Aug 02 10:56:06.639855 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: exception: Instance b4dbc5ca-f31e-44e8-9573-6e79e891b989 could not be found. Aug 02 10:56:06.639855 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: action_args: {'id': 'b4dbc5ca-f31e-44e8-9573-6e79e891b989'} Aug 02 10:56:06.640566 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:56:06.640566 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:56:06.640566 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 10:56:06.640566 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 10:56:06.640566 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 10:56:06.640566 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 10:56:06.640566 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 10:56:06.640566 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 10:56:06.640566 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 10:56:06.640566 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 10:56:06.640566 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4dbc5ca-f31e-44e8-9573-6e79e891b989 could not be found. Aug 02 10:56:06.640566 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 10:56:06.640566 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:56:06.640566 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 10:56:06.640566 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:56:06.640566 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:56:06.640566 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:56:06.640566 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:56:06.640566 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:56:06.640566 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:56:06.641697 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:56:06.641697 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 10:56:06.641697 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 10:56:06.641697 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 10:56:06.641697 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 10:56:06.641697 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 10:56:06.641697 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 10:56:06.641697 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4dbc5ca-f31e-44e8-9573-6e79e891b989 could not be found. Aug 02 10:56:06.641697 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 10:56:06.641697 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:56:06.641697 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 10:56:06.641697 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:56:06.641697 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:56:06.641697 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:56:06.641697 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:56:06.641697 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:56:06.641697 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4dbc5ca-f31e-44e8-9573-6e79e891b989 could not be found. Aug 02 10:56:06.641697 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 10:56:06.642733 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-b73186f3-9594-4b54-9118-372bd78bf46a tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] Returning 404 to user: Instance b4dbc5ca-f31e-44e8-9573-6e79e891b989 could not be found. {{(pid=129952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:56:06.642733 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-b73186f3-9594-4b54-9118-372bd78bf46a tempest-DeleteServersTestJSON-1083452059 tempest-DeleteServersTestJSON-1083452059-project] 10.222.0.115 "GET /compute/v2.1/servers/b4dbc5ca-f31e-44e8-9573-6e79e891b989" status: 404 len: 111 microversion: 2.1 time: 0.081265 Aug 02 10:56:06.642733 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 63/135] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:56:06 2022] GET /compute/v2.1/servers/b4dbc5ca-f31e-44e8-9573-6e79e891b989 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 10:56:20.942622 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG dbcounter [-] [129953] Writing DB stats nova_api:SELECT=45 {{(pid=129953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:56:20.943394 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG dbcounter [-] [129953] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:56:21.127637 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-7dbb0153-d2cd-456e-9d43-7cd680c45bdd tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1174145893", "imageRef": "aa0a7b8c-0dd6-4803-8767-cb8c2d05fdd4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:56:21.195022 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.network.neutron [None req-7dbb0153-d2cd-456e-9d43-7cd680c45bdd tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] validate_networks() for [('e214b1a0-f6ae-4d74-8b26-44991d3744df', None, None, None, None, None)] {{(pid=129953) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 10:56:21.646735 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.virt.hardware [None req-7dbb0153-d2cd-456e-9d43-7cd680c45bdd tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Flavor limits 0:0:0 {{(pid=129953) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 10:56:21.647751 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.virt.hardware [None req-7dbb0153-d2cd-456e-9d43-7cd680c45bdd tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Image limits 0:0:0 {{(pid=129953) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 10:56:21.648397 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.virt.hardware [None req-7dbb0153-d2cd-456e-9d43-7cd680c45bdd tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Flavor pref 0:0:0 {{(pid=129953) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 10:56:21.648805 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.virt.hardware [None req-7dbb0153-d2cd-456e-9d43-7cd680c45bdd tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Image pref 0:0:0 {{(pid=129953) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 10:56:21.649223 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.virt.hardware [None req-7dbb0153-d2cd-456e-9d43-7cd680c45bdd tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129953) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 10:56:21.664025 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-7dbb0153-d2cd-456e-9d43-7cd680c45bdd tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:21.664381 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-7dbb0153-d2cd-456e-9d43-7cd680c45bdd tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:21.665177 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-7dbb0153-d2cd-456e-9d43-7cd680c45bdd tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:21.665610 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-7dbb0153-d2cd-456e-9d43-7cd680c45bdd tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:21.693949 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.quota [None req-7dbb0153-d2cd-456e-9d43-7cd680c45bdd tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Getting quotas for project 0d99d3fd13df429a8ee8a7cb7780adb5. Resources: {'instances', 'cores', 'ram'} {{(pid=129953) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 10:56:21.698456 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.quota [None req-7dbb0153-d2cd-456e-9d43-7cd680c45bdd tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Getting quotas for user 3057a53debc34c829372c03567e1119d and project 0d99d3fd13df429a8ee8a7cb7780adb5. Resources: {'instances', 'cores', 'ram'} {{(pid=129953) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 10:56:21.713252 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-7dbb0153-d2cd-456e-9d43-7cd680c45bdd tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Going to run 1 instances... {{(pid=129953) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 10:56:21.715014 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-7dbb0153-d2cd-456e-9d43-7cd680c45bdd tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: e7deeb40-9fc3-40f8-b564-192fe68fa113] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aa0a7b8c-0dd6-4803-8767-cb8c2d05fdd4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129953) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 10:56:21.905165 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-7dbb0153-d2cd-456e-9d43-7cd680c45bdd tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "POST /compute/v2.1/servers" status: 202 len: 385 microversion: 2.1 time: 0.967218 Aug 02 10:56:21.906099 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 73/136] 10.222.0.115 () {60 vars in 1152 bytes} [Tue Aug 2 10:56:20 2022] POST /compute/v2.1/servers => generated 385 bytes in 969 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 02 10:56:21.918548 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-77a1d456-2fdf-4064-9cf9-0d7990b76832 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:56:21.919907 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-77a1d456-2fdf-4064-9cf9-0d7990b76832 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: e7deeb40-9fc3-40f8-b564-192fe68fa113] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:56:21.922470 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG dbcounter [-] [129952] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1 {{(pid=129952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:56:21.923791 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG dbcounter [-] [129952] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:56:21.985611 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-77a1d456-2fdf-4064-9cf9-0d7990b76832 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:56:21.992402 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-77a1d456-2fdf-4064-9cf9-0d7990b76832 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/e7deeb40-9fc3-40f8-b564-192fe68fa113" status: 200 len: 1226 microversion: 2.1 time: 0.078294 Aug 02 10:56:21.994458 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 64/137] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:56:21 2022] GET /compute/v2.1/servers/e7deeb40-9fc3-40f8-b564-192fe68fa113 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:56:22.072798 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-08d58b51-7b70-4932-a362-3102351633ab tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1155539900", "imageRef": "aa0a7b8c-0dd6-4803-8767-cb8c2d05fdd4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:56:22.144204 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.network.neutron [None req-08d58b51-7b70-4932-a362-3102351633ab tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] validate_networks() for [('e214b1a0-f6ae-4d74-8b26-44991d3744df', None, None, None, None, None)] {{(pid=129953) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 10:56:22.670187 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.virt.hardware [None req-08d58b51-7b70-4932-a362-3102351633ab tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Flavor limits 0:0:0 {{(pid=129953) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 10:56:22.671863 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.virt.hardware [None req-08d58b51-7b70-4932-a362-3102351633ab tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Image limits 0:0:0 {{(pid=129953) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 10:56:22.671863 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.virt.hardware [None req-08d58b51-7b70-4932-a362-3102351633ab tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Flavor pref 0:0:0 {{(pid=129953) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 10:56:22.671863 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.virt.hardware [None req-08d58b51-7b70-4932-a362-3102351633ab tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Image pref 0:0:0 {{(pid=129953) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 10:56:22.672119 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.virt.hardware [None req-08d58b51-7b70-4932-a362-3102351633ab tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129953) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 10:56:22.682307 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-08d58b51-7b70-4932-a362-3102351633ab tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:22.683795 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-08d58b51-7b70-4932-a362-3102351633ab tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:22.684881 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-08d58b51-7b70-4932-a362-3102351633ab tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:22.685563 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-08d58b51-7b70-4932-a362-3102351633ab tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:22.711130 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.quota [None req-08d58b51-7b70-4932-a362-3102351633ab tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Getting quotas for project 0d99d3fd13df429a8ee8a7cb7780adb5. Resources: {'instances', 'cores', 'ram'} {{(pid=129953) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 10:56:22.717726 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.quota [None req-08d58b51-7b70-4932-a362-3102351633ab tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Getting quotas for user 3057a53debc34c829372c03567e1119d and project 0d99d3fd13df429a8ee8a7cb7780adb5. Resources: {'instances', 'cores', 'ram'} {{(pid=129953) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 10:56:22.730868 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-08d58b51-7b70-4932-a362-3102351633ab tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Going to run 1 instances... {{(pid=129953) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 10:56:22.733488 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-08d58b51-7b70-4932-a362-3102351633ab tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 454053f7-16a6-42c3-9ba0-ca0a40dc5c4b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aa0a7b8c-0dd6-4803-8767-cb8c2d05fdd4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129953) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 10:56:22.942238 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-08d58b51-7b70-4932-a362-3102351633ab tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "POST /compute/v2.1/servers" status: 202 len: 385 microversion: 2.1 time: 0.876204 Aug 02 10:56:22.942796 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 74/138] 10.222.0.115 () {60 vars in 1152 bytes} [Tue Aug 2 10:56:22 2022] POST /compute/v2.1/servers => generated 385 bytes in 878 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 02 10:56:22.958681 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-e1f6d648-c6a7-420b-ae7c-0790f037e10e tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:56:22.963106 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-e1f6d648-c6a7-420b-ae7c-0790f037e10e tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 454053f7-16a6-42c3-9ba0-ca0a40dc5c4b] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:56:23.024223 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-e1f6d648-c6a7-420b-ae7c-0790f037e10e tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:56:23.033601 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-e1f6d648-c6a7-420b-ae7c-0790f037e10e tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b" status: 200 len: 1226 microversion: 2.1 time: 0.082736 Aug 02 10:56:23.044184 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 65/139] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:56:22 2022] GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:56:24.057094 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-478abd12-30e4-4b48-9126-a9739efcf6ef tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:56:24.057702 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-478abd12-30e4-4b48-9126-a9739efcf6ef tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 454053f7-16a6-42c3-9ba0-ca0a40dc5c4b] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:56:24.068121 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-478abd12-30e4-4b48-9126-a9739efcf6ef tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:24.068806 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-478abd12-30e4-4b48-9126-a9739efcf6ef tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:24.069723 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-478abd12-30e4-4b48-9126-a9739efcf6ef tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:24.070170 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-478abd12-30e4-4b48-9126-a9739efcf6ef tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:24.169700 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-478abd12-30e4-4b48-9126-a9739efcf6ef tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:56:24.178116 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-478abd12-30e4-4b48-9126-a9739efcf6ef tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b" status: 200 len: 1230 microversion: 2.1 time: 0.125237 Aug 02 10:56:24.178953 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 75/140] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:56:24 2022] GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b => generated 1230 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:56:25.199916 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-e1e4c305-c590-4743-a817-fb1f7de02aef tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:56:25.200786 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-e1e4c305-c590-4743-a817-fb1f7de02aef tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 454053f7-16a6-42c3-9ba0-ca0a40dc5c4b] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:56:25.208916 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-e1e4c305-c590-4743-a817-fb1f7de02aef tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:25.209718 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-e1e4c305-c590-4743-a817-fb1f7de02aef tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:25.210726 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-e1e4c305-c590-4743-a817-fb1f7de02aef tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:25.215900 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-e1e4c305-c590-4743-a817-fb1f7de02aef tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:25.359466 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-e1e4c305-c590-4743-a817-fb1f7de02aef tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:56:25.367780 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-e1e4c305-c590-4743-a817-fb1f7de02aef tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b" status: 200 len: 1278 microversion: 2.1 time: 0.171830 Aug 02 10:56:25.395709 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 66/141] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:56:25 2022] GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b => generated 1278 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:56:26.393083 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-d718dfc0-74c9-4517-a0c8-cc58669f23cf tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:56:26.393795 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-d718dfc0-74c9-4517-a0c8-cc58669f23cf tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 454053f7-16a6-42c3-9ba0-ca0a40dc5c4b] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:56:26.410676 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-d718dfc0-74c9-4517-a0c8-cc58669f23cf tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:26.411381 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-d718dfc0-74c9-4517-a0c8-cc58669f23cf tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:26.412425 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-d718dfc0-74c9-4517-a0c8-cc58669f23cf tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:26.414138 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-d718dfc0-74c9-4517-a0c8-cc58669f23cf tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:26.564456 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-d718dfc0-74c9-4517-a0c8-cc58669f23cf tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:56:26.575438 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-d718dfc0-74c9-4517-a0c8-cc58669f23cf tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b" status: 200 len: 1284 microversion: 2.1 time: 0.185865 Aug 02 10:56:26.581419 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 76/142] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:56:26 2022] GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b => generated 1284 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:56:27.608752 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-5b587853-8ec9-44a6-affc-4e3d00d55437 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:56:27.609450 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-5b587853-8ec9-44a6-affc-4e3d00d55437 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 454053f7-16a6-42c3-9ba0-ca0a40dc5c4b] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:56:27.615760 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-5b587853-8ec9-44a6-affc-4e3d00d55437 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:27.616212 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-5b587853-8ec9-44a6-affc-4e3d00d55437 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:27.616978 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-5b587853-8ec9-44a6-affc-4e3d00d55437 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:27.617405 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-5b587853-8ec9-44a6-affc-4e3d00d55437 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:27.753603 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-5b587853-8ec9-44a6-affc-4e3d00d55437 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:56:27.761307 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-5b587853-8ec9-44a6-affc-4e3d00d55437 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b" status: 200 len: 1326 microversion: 2.1 time: 0.156732 Aug 02 10:56:27.761972 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 67/143] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:56:27 2022] GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b => generated 1326 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:56:28.111641 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [req-303f09f2-b86a-4642-93ab-5531054d15d7 req-09fa625f-755e-4faf-a8c3-b768ff3d2ad2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7deeb40-9fc3-40f8-b564-192fe68fa113", "tag": "f402df7f-32e4-4cbd-9bdb-6f6e8d92473e"}]} {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:56:28.149996 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [req-303f09f2-b86a-4642-93ab-5531054d15d7 req-09fa625f-755e-4faf-a8c3-b768ff3d2ad2 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:28.158617 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [req-303f09f2-b86a-4642-93ab-5531054d15d7 req-09fa625f-755e-4faf-a8c3-b768ff3d2ad2 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:28.173233 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.compute.server_external_events [req-303f09f2-b86a-4642-93ab-5531054d15d7 req-09fa625f-755e-4faf-a8c3-b768ff3d2ad2 service nova] Creating event network-changed:f402df7f-32e4-4cbd-9bdb-6f6e8d92473e for instance e7deeb40-9fc3-40f8-b564-192fe68fa113 on hv-cinder-85031 Aug 02 10:56:28.180561 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [req-303f09f2-b86a-4642-93ab-5531054d15d7 req-09fa625f-755e-4faf-a8c3-b768ff3d2ad2 service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073684 Aug 02 10:56:28.181272 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 77/144] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Aug 2 10:56:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:56:28.405303 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [req-d92de8d7-3b55-4411-a62d-8642e959a0c2 req-c2faa2a8-2ec5-4a33-8e25-eb115b833e1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "454053f7-16a6-42c3-9ba0-ca0a40dc5c4b", "tag": "5d1bea73-be61-41ee-85a1-34d315b157ef"}]} {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:56:28.421339 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [req-d92de8d7-3b55-4411-a62d-8642e959a0c2 req-c2faa2a8-2ec5-4a33-8e25-eb115b833e1b service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:28.422102 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [req-d92de8d7-3b55-4411-a62d-8642e959a0c2 req-c2faa2a8-2ec5-4a33-8e25-eb115b833e1b service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:28.448031 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.compute.server_external_events [req-d92de8d7-3b55-4411-a62d-8642e959a0c2 req-c2faa2a8-2ec5-4a33-8e25-eb115b833e1b service nova] Creating event network-changed:5d1bea73-be61-41ee-85a1-34d315b157ef for instance 454053f7-16a6-42c3-9ba0-ca0a40dc5c4b on hv-cinder-85031 Aug 02 10:56:28.452203 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [req-d92de8d7-3b55-4411-a62d-8642e959a0c2 req-c2faa2a8-2ec5-4a33-8e25-eb115b833e1b service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051505 Aug 02 10:56:28.454462 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 68/145] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Aug 2 10:56:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:56:28.785360 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-d0f8e853-f893-42d8-a4e5-2cbd06b85d98 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:56:28.786219 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-d0f8e853-f893-42d8-a4e5-2cbd06b85d98 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 454053f7-16a6-42c3-9ba0-ca0a40dc5c4b] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:56:28.793347 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-d0f8e853-f893-42d8-a4e5-2cbd06b85d98 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:28.794188 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-d0f8e853-f893-42d8-a4e5-2cbd06b85d98 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:28.795040 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-d0f8e853-f893-42d8-a4e5-2cbd06b85d98 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:28.795829 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-d0f8e853-f893-42d8-a4e5-2cbd06b85d98 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:29.066974 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-d0f8e853-f893-42d8-a4e5-2cbd06b85d98 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:56:29.075888 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-d0f8e853-f893-42d8-a4e5-2cbd06b85d98 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b" status: 200 len: 1326 microversion: 2.1 time: 0.294895 Aug 02 10:56:29.076473 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 78/146] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:56:28 2022] GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b => generated 1326 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:56:30.101455 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-b56096ea-db9a-4d81-88f8-8583ac516a82 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:56:30.103390 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-b56096ea-db9a-4d81-88f8-8583ac516a82 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 454053f7-16a6-42c3-9ba0-ca0a40dc5c4b] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:56:30.113638 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-b56096ea-db9a-4d81-88f8-8583ac516a82 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:30.114573 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-b56096ea-db9a-4d81-88f8-8583ac516a82 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:30.115981 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-b56096ea-db9a-4d81-88f8-8583ac516a82 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:30.116673 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-b56096ea-db9a-4d81-88f8-8583ac516a82 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:30.262727 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-b56096ea-db9a-4d81-88f8-8583ac516a82 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:56:30.271076 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-b56096ea-db9a-4d81-88f8-8583ac516a82 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b" status: 200 len: 1326 microversion: 2.1 time: 0.175974 Aug 02 10:56:30.272152 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 69/147] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:56:30 2022] GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b => generated 1326 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:56:31.292317 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-011746f0-1b10-4260-8e04-1b9bd7c932e1 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:56:31.293044 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-011746f0-1b10-4260-8e04-1b9bd7c932e1 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 454053f7-16a6-42c3-9ba0-ca0a40dc5c4b] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:56:31.299909 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-011746f0-1b10-4260-8e04-1b9bd7c932e1 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:31.300355 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-011746f0-1b10-4260-8e04-1b9bd7c932e1 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:31.301197 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-011746f0-1b10-4260-8e04-1b9bd7c932e1 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:31.301585 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-011746f0-1b10-4260-8e04-1b9bd7c932e1 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:31.445343 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-011746f0-1b10-4260-8e04-1b9bd7c932e1 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:56:31.453560 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-011746f0-1b10-4260-8e04-1b9bd7c932e1 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b" status: 200 len: 1326 microversion: 2.1 time: 0.165162 Aug 02 10:56:31.454141 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 79/148] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:56:31 2022] GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b => generated 1326 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:56:32.475256 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-0c9cc1bf-107a-4d4b-997f-0b4b22495aab tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:56:32.475859 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-0c9cc1bf-107a-4d4b-997f-0b4b22495aab tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 454053f7-16a6-42c3-9ba0-ca0a40dc5c4b] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:56:32.482925 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-0c9cc1bf-107a-4d4b-997f-0b4b22495aab tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:32.483440 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-0c9cc1bf-107a-4d4b-997f-0b4b22495aab tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:32.484181 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-0c9cc1bf-107a-4d4b-997f-0b4b22495aab tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:32.484609 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-0c9cc1bf-107a-4d4b-997f-0b4b22495aab tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:32.617828 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-0c9cc1bf-107a-4d4b-997f-0b4b22495aab tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:56:32.625792 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-0c9cc1bf-107a-4d4b-997f-0b4b22495aab tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b" status: 200 len: 1326 microversion: 2.1 time: 0.154684 Aug 02 10:56:32.626379 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 70/149] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:56:32 2022] GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b => generated 1326 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:56:32.837078 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-f036bd87-a98d-4a62-8285-d706f7d01c38 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:56:32.837582 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-f036bd87-a98d-4a62-8285-d706f7d01c38 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: 8a7b8f4c-0c11-406f-bed6-b4fd18e3c304] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:56:32.840513 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG dbcounter [-] [129953] Writing DB stats nova_cell0:SELECT=4 {{(pid=129953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:56:32.841246 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG dbcounter [-] [129953] Writing DB stats nova_cell0:SELECT=12 {{(pid=129953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:56:32.846029 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-f036bd87-a98d-4a62-8285-d706f7d01c38 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:32.846485 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-f036bd87-a98d-4a62-8285-d706f7d01c38 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:32.847352 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-f036bd87-a98d-4a62-8285-d706f7d01c38 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:32.852155 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-f036bd87-a98d-4a62-8285-d706f7d01c38 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:32.872280 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-f036bd87-a98d-4a62-8285-d706f7d01c38 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "GET /compute/v2.1/servers/8a7b8f4c-0c11-406f-bed6-b4fd18e3c304/ips" status: 200 len: 151 microversion: 2.1 time: 0.038826 Aug 02 10:56:32.872780 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 80/150] 10.222.0.115 () {58 vars in 1253 bytes} [Tue Aug 2 10:56:32 2022] GET /compute/v2.1/servers/8a7b8f4c-0c11-406f-bed6-b4fd18e3c304/ips => generated 151 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:56:33.375340 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-4df7505f-4bf6-4f99-907b-a7fca3e7f303 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:56:33.375835 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-4df7505f-4bf6-4f99-907b-a7fca3e7f303 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] [instance: 3938932a-e778-4c0c-9ab0-78dc9082a48e] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:56:33.377910 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG dbcounter [-] [129952] Writing DB stats nova_cell0:SELECT=4 {{(pid=129952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:56:33.383337 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-4df7505f-4bf6-4f99-907b-a7fca3e7f303 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:33.384025 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-4df7505f-4bf6-4f99-907b-a7fca3e7f303 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:33.384801 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-4df7505f-4bf6-4f99-907b-a7fca3e7f303 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:33.385241 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-4df7505f-4bf6-4f99-907b-a7fca3e7f303 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:33.414378 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-4df7505f-4bf6-4f99-907b-a7fca3e7f303 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] 10.222.0.115 "GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e/ips" status: 200 len: 145 microversion: 2.1 time: 0.043174 Aug 02 10:56:33.414910 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 71/151] 10.222.0.115 () {58 vars in 1253 bytes} [Tue Aug 2 10:56:33 2022] GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e/ips => generated 145 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:56:33.647805 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-3a7dca17-59cd-47ce-8865-781b63fe7a8a tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:56:33.648408 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-3a7dca17-59cd-47ce-8865-781b63fe7a8a tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 454053f7-16a6-42c3-9ba0-ca0a40dc5c4b] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:56:33.656495 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-3a7dca17-59cd-47ce-8865-781b63fe7a8a tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:33.656936 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-3a7dca17-59cd-47ce-8865-781b63fe7a8a tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:33.657694 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-3a7dca17-59cd-47ce-8865-781b63fe7a8a tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:33.658130 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-3a7dca17-59cd-47ce-8865-781b63fe7a8a tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:33.795038 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-3a7dca17-59cd-47ce-8865-781b63fe7a8a tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:56:33.803039 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-3a7dca17-59cd-47ce-8865-781b63fe7a8a tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b" status: 200 len: 1326 microversion: 2.1 time: 0.159492 Aug 02 10:56:33.803701 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 81/152] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:56:33 2022] GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b => generated 1326 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:56:34.825066 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-f7bbec09-d1eb-48de-9d06-c011a2eca267 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:56:34.825693 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-f7bbec09-d1eb-48de-9d06-c011a2eca267 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 454053f7-16a6-42c3-9ba0-ca0a40dc5c4b] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:56:34.832506 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-f7bbec09-d1eb-48de-9d06-c011a2eca267 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:34.832958 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-f7bbec09-d1eb-48de-9d06-c011a2eca267 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:34.833755 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-f7bbec09-d1eb-48de-9d06-c011a2eca267 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:34.834193 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-f7bbec09-d1eb-48de-9d06-c011a2eca267 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:34.971317 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-f7bbec09-d1eb-48de-9d06-c011a2eca267 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:56:34.978745 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-f7bbec09-d1eb-48de-9d06-c011a2eca267 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b" status: 200 len: 1326 microversion: 2.1 time: 0.158636 Aug 02 10:56:34.979344 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 72/153] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:56:34 2022] GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b => generated 1326 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:56:35.729367 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [req-f5027187-6a3b-4266-8c82-bb31104a97e9 req-b72fe191-25c6-4a33-90fc-a4d79b71ec79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7deeb40-9fc3-40f8-b564-192fe68fa113", "name": "network-vif-plugged", "status": "completed", "tag": "f402df7f-32e4-4cbd-9bdb-6f6e8d92473e"}]} {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:56:35.737694 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-eb662e99-72fc-473d-b733-12f9312ec01f tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9de4c0fd-b9a7-40d2-b857-8cc654a6f15a"}} {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:56:35.740127 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-eb662e99-72fc-473d-b733-12f9312ec01f tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: 8a7b8f4c-0c11-406f-bed6-b4fd18e3c304] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:56:35.746998 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-eb662e99-72fc-473d-b733-12f9312ec01f tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:35.747188 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [req-f5027187-6a3b-4266-8c82-bb31104a97e9 req-b72fe191-25c6-4a33-90fc-a4d79b71ec79 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:35.748268 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [req-f5027187-6a3b-4266-8c82-bb31104a97e9 req-b72fe191-25c6-4a33-90fc-a4d79b71ec79 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:35.748383 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-eb662e99-72fc-473d-b733-12f9312ec01f tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:35.748981 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-eb662e99-72fc-473d-b733-12f9312ec01f tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:35.749619 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-eb662e99-72fc-473d-b733-12f9312ec01f tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:35.759656 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.compute.server_external_events [req-f5027187-6a3b-4266-8c82-bb31104a97e9 req-b72fe191-25c6-4a33-90fc-a4d79b71ec79 service nova] Creating event network-vif-plugged:f402df7f-32e4-4cbd-9bdb-6f6e8d92473e for instance e7deeb40-9fc3-40f8-b564-192fe68fa113 on hv-cinder-85031 Aug 02 10:56:35.766934 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [req-f5027187-6a3b-4266-8c82-bb31104a97e9 req-b72fe191-25c6-4a33-90fc-a4d79b71ec79 service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041960 Aug 02 10:56:35.767605 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 82/154] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Aug 2 10:56:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:56:35.799015 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-901baf02-ba3d-4c89-9e12-f6382541c048 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:56:35.799738 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-901baf02-ba3d-4c89-9e12-f6382541c048 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: b3a92fc5-5c44-48d1-8394-535687bb6ae3] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:56:35.810356 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-901baf02-ba3d-4c89-9e12-f6382541c048 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:35.814141 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-901baf02-ba3d-4c89-9e12-f6382541c048 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:35.815409 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-901baf02-ba3d-4c89-9e12-f6382541c048 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:35.818393 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-901baf02-ba3d-4c89-9e12-f6382541c048 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:35.860930 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-901baf02-ba3d-4c89-9e12-f6382541c048 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3/ips" status: 200 len: 153 microversion: 2.20 time: 0.085578 Aug 02 10:56:35.861513 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 83/155] 10.222.0.115 () {60 vars in 1294 bytes} [Tue Aug 2 10:56:35 2022] GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3/ips => generated 153 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:56:36.023747 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-09a23381-5592-49f2-b4f1-06d4febf987f tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:56:36.023747 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-09a23381-5592-49f2-b4f1-06d4febf987f tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 454053f7-16a6-42c3-9ba0-ca0a40dc5c4b] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:56:36.023747 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-09a23381-5592-49f2-b4f1-06d4febf987f tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:36.023747 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-09a23381-5592-49f2-b4f1-06d4febf987f tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:36.025160 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-09a23381-5592-49f2-b4f1-06d4febf987f tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:36.025160 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-09a23381-5592-49f2-b4f1-06d4febf987f tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:36.184332 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-09a23381-5592-49f2-b4f1-06d4febf987f tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:56:36.192874 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-09a23381-5592-49f2-b4f1-06d4febf987f tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b" status: 200 len: 1326 microversion: 2.1 time: 0.192030 Aug 02 10:56:36.196754 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 84/156] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:56:35 2022] GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b => generated 1326 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:56:37.214231 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-81a0a631-5798-4b8f-bc81-a45f21bda4a1 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:56:37.214906 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-81a0a631-5798-4b8f-bc81-a45f21bda4a1 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 454053f7-16a6-42c3-9ba0-ca0a40dc5c4b] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:56:37.222776 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-81a0a631-5798-4b8f-bc81-a45f21bda4a1 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:37.223496 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-81a0a631-5798-4b8f-bc81-a45f21bda4a1 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:37.224255 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-81a0a631-5798-4b8f-bc81-a45f21bda4a1 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:37.225034 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-81a0a631-5798-4b8f-bc81-a45f21bda4a1 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:37.368800 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-81a0a631-5798-4b8f-bc81-a45f21bda4a1 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:56:37.376407 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-81a0a631-5798-4b8f-bc81-a45f21bda4a1 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b" status: 200 len: 1326 microversion: 2.1 time: 0.166280 Aug 02 10:56:37.376972 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 85/157] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:56:37 2022] GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b => generated 1326 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:56:37.421412 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-eb662e99-72fc-473d-b733-12f9312ec01f tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "POST /compute/v2.1/servers/8a7b8f4c-0c11-406f-bed6-b4fd18e3c304/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.687882 Aug 02 10:56:37.422191 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 73/158] 10.222.0.115 () {60 vars in 1328 bytes} [Tue Aug 2 10:56:35 2022] POST /compute/v2.1/servers/8a7b8f4c-0c11-406f-bed6-b4fd18e3c304/os-volume_attachments => generated 194 bytes in 1689 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:56:38.398583 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-e083ac73-986f-43c7-899d-8a68b7280ab4 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:56:38.400042 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-e083ac73-986f-43c7-899d-8a68b7280ab4 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 454053f7-16a6-42c3-9ba0-ca0a40dc5c4b] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:56:38.408107 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-e083ac73-986f-43c7-899d-8a68b7280ab4 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:38.408811 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-e083ac73-986f-43c7-899d-8a68b7280ab4 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:38.409786 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-e083ac73-986f-43c7-899d-8a68b7280ab4 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:38.410405 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-e083ac73-986f-43c7-899d-8a68b7280ab4 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:38.609624 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-e083ac73-986f-43c7-899d-8a68b7280ab4 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:56:38.622184 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-e083ac73-986f-43c7-899d-8a68b7280ab4 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b" status: 200 len: 1326 microversion: 2.1 time: 0.227859 Aug 02 10:56:38.623998 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 86/159] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:56:38 2022] GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b => generated 1326 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:56:39.654454 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-9ae6d079-671b-4096-b63f-9f1144150d32 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:56:39.655505 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-9ae6d079-671b-4096-b63f-9f1144150d32 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 454053f7-16a6-42c3-9ba0-ca0a40dc5c4b] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:56:39.664095 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-9ae6d079-671b-4096-b63f-9f1144150d32 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:39.664848 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-9ae6d079-671b-4096-b63f-9f1144150d32 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:39.665776 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-9ae6d079-671b-4096-b63f-9f1144150d32 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:39.666219 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-9ae6d079-671b-4096-b63f-9f1144150d32 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:39.901103 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-9ae6d079-671b-4096-b63f-9f1144150d32 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:56:39.931267 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-9ae6d079-671b-4096-b63f-9f1144150d32 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b" status: 200 len: 1326 microversion: 2.1 time: 0.282353 Aug 02 10:56:39.932212 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 74/160] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:56:39 2022] GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b => generated 1326 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:56:40.729486 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-bf6db670-9b84-4063-b5af-d727153a1b90 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9e79746f-c0b3-4b2f-8c8f-59118274f943"}} {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:56:40.732131 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-bf6db670-9b84-4063-b5af-d727153a1b90 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] [instance: 3938932a-e778-4c0c-9ab0-78dc9082a48e] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:56:40.748041 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-bf6db670-9b84-4063-b5af-d727153a1b90 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:40.748041 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-bf6db670-9b84-4063-b5af-d727153a1b90 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:40.748041 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-bf6db670-9b84-4063-b5af-d727153a1b90 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:40.748041 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-bf6db670-9b84-4063-b5af-d727153a1b90 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:40.953176 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-f5128291-bfdf-43eb-bf4c-a2de93efdd7f tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:56:40.954452 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-f5128291-bfdf-43eb-bf4c-a2de93efdd7f tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 454053f7-16a6-42c3-9ba0-ca0a40dc5c4b] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:56:40.961719 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-f5128291-bfdf-43eb-bf4c-a2de93efdd7f tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:40.962426 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-f5128291-bfdf-43eb-bf4c-a2de93efdd7f tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:40.975561 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-f5128291-bfdf-43eb-bf4c-a2de93efdd7f tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:40.976541 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-f5128291-bfdf-43eb-bf4c-a2de93efdd7f tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:41.224989 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-f5128291-bfdf-43eb-bf4c-a2de93efdd7f tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:56:41.233861 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-f5128291-bfdf-43eb-bf4c-a2de93efdd7f tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b" status: 200 len: 1326 microversion: 2.1 time: 0.285852 Aug 02 10:56:41.234469 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 75/161] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:56:40 2022] GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b => generated 1326 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:56:41.264894 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-b9f35fb7-1670-40f0-b054-629a5e93e9f4 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:56:41.265608 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-b9f35fb7-1670-40f0-b054-629a5e93e9f4 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: b3a92fc5-5c44-48d1-8394-535687bb6ae3] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:56:41.275616 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-b9f35fb7-1670-40f0-b054-629a5e93e9f4 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:41.275616 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-b9f35fb7-1670-40f0-b054-629a5e93e9f4 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:41.276155 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-b9f35fb7-1670-40f0-b054-629a5e93e9f4 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:41.276568 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-b9f35fb7-1670-40f0-b054-629a5e93e9f4 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:41.317092 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.objects.instance [None req-b9f35fb7-1670-40f0-b054-629a5e93e9f4 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lazy-loading 'flavor' on Instance uuid b3a92fc5-5c44-48d1-8394-535687bb6ae3 {{(pid=129952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 10:56:41.869240 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-bf6db670-9b84-4063-b5af-d727153a1b90 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] 10.222.0.115 "POST /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.143070 Aug 02 10:56:41.871085 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 87/162] 10.222.0.115 () {60 vars in 1328 bytes} [Tue Aug 2 10:56:40 2022] POST /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e/os-volume_attachments => generated 194 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:56:42.042329 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-b9f35fb7-1670-40f0-b054-629a5e93e9f4 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "POST /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3/action" status: 202 len: 0 microversion: 2.20 time: 0.783113 Aug 02 10:56:42.046877 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 76/163] 10.222.0.115 () {62 vars in 1324 bytes} [Tue Aug 2 10:56:41 2022] POST /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3/action => generated 0 bytes in 785 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 02 10:56:42.053354 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-1cb787de-1872-4db8-b9e6-9cead267d9b7 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:56:42.055253 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-1cb787de-1872-4db8-b9e6-9cead267d9b7 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: b3a92fc5-5c44-48d1-8394-535687bb6ae3] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:56:42.061914 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-1cb787de-1872-4db8-b9e6-9cead267d9b7 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:42.062358 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-1cb787de-1872-4db8-b9e6-9cead267d9b7 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:42.063171 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-1cb787de-1872-4db8-b9e6-9cead267d9b7 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:42.064190 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-1cb787de-1872-4db8-b9e6-9cead267d9b7 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:42.207397 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [req-14cb2fd4-3a70-4a0f-880b-efa813c9ef85 req-5b7006a3-fe7b-48ad-8994-6359c692a5c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "454053f7-16a6-42c3-9ba0-ca0a40dc5c4b", "name": "network-vif-plugged", "status": "completed", "tag": "5d1bea73-be61-41ee-85a1-34d315b157ef"}]} {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:56:42.224363 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [req-14cb2fd4-3a70-4a0f-880b-efa813c9ef85 req-5b7006a3-fe7b-48ad-8994-6359c692a5c4 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:42.224890 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [req-14cb2fd4-3a70-4a0f-880b-efa813c9ef85 req-5b7006a3-fe7b-48ad-8994-6359c692a5c4 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:42.238688 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.compute.server_external_events [req-14cb2fd4-3a70-4a0f-880b-efa813c9ef85 req-5b7006a3-fe7b-48ad-8994-6359c692a5c4 service nova] Creating event network-vif-plugged:5d1bea73-be61-41ee-85a1-34d315b157ef for instance 454053f7-16a6-42c3-9ba0-ca0a40dc5c4b on hv-cinder-85031 Aug 02 10:56:42.244015 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [req-14cb2fd4-3a70-4a0f-880b-efa813c9ef85 req-5b7006a3-fe7b-48ad-8994-6359c692a5c4 service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040585 Aug 02 10:56:42.245104 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 77/164] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Aug 2 10:56:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:56:42.266424 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-6f9f1be4-bb83-4707-8c16-97b5b4db6832 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:56:42.267172 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-6f9f1be4-bb83-4707-8c16-97b5b4db6832 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 454053f7-16a6-42c3-9ba0-ca0a40dc5c4b] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:56:42.273509 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-6f9f1be4-bb83-4707-8c16-97b5b4db6832 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:42.275502 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-6f9f1be4-bb83-4707-8c16-97b5b4db6832 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:42.275502 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-6f9f1be4-bb83-4707-8c16-97b5b4db6832 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:42.275502 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-6f9f1be4-bb83-4707-8c16-97b5b4db6832 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:42.358692 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-1cb787de-1872-4db8-b9e6-9cead267d9b7 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:56:42.367356 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-1cb787de-1872-4db8-b9e6-9cead267d9b7 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:56:42.369381 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-1cb787de-1872-4db8-b9e6-9cead267d9b7 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:56:42.374594 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-1cb787de-1872-4db8-b9e6-9cead267d9b7 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3" status: 200 len: 1728 microversion: 2.20 time: 0.325786 Aug 02 10:56:42.375889 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 88/165] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 10:56:42 2022] GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3 => generated 1728 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:56:42.538397 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-6f9f1be4-bb83-4707-8c16-97b5b4db6832 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:56:42.550597 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-6f9f1be4-bb83-4707-8c16-97b5b4db6832 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b" status: 200 len: 1326 microversion: 2.1 time: 0.290734 Aug 02 10:56:42.551633 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 78/166] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:56:42 2022] GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b => generated 1326 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:56:43.398336 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-a2a25ec2-3081-4908-bb47-b8e0079d4753 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:56:43.398959 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-a2a25ec2-3081-4908-bb47-b8e0079d4753 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: b3a92fc5-5c44-48d1-8394-535687bb6ae3] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:56:43.406489 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-a2a25ec2-3081-4908-bb47-b8e0079d4753 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:43.406929 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-a2a25ec2-3081-4908-bb47-b8e0079d4753 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:43.407738 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-a2a25ec2-3081-4908-bb47-b8e0079d4753 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:43.408203 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-a2a25ec2-3081-4908-bb47-b8e0079d4753 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:43.561169 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-a2a25ec2-3081-4908-bb47-b8e0079d4753 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:56:43.569937 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-a2a25ec2-3081-4908-bb47-b8e0079d4753 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:56:43.571483 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-a2a25ec2-3081-4908-bb47-b8e0079d4753 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:56:43.572579 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-4ce81335-f4bf-4d44-8166-0d4cf67e1926 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:56:43.573007 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-a2a25ec2-3081-4908-bb47-b8e0079d4753 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3" status: 200 len: 1728 microversion: 2.20 time: 0.178379 Aug 02 10:56:43.573230 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 89/167] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 10:56:43 2022] GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3 => generated 1728 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:56:43.573702 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-4ce81335-f4bf-4d44-8166-0d4cf67e1926 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 454053f7-16a6-42c3-9ba0-ca0a40dc5c4b] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:56:43.580723 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-4ce81335-f4bf-4d44-8166-0d4cf67e1926 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:43.581165 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-4ce81335-f4bf-4d44-8166-0d4cf67e1926 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:43.581924 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-4ce81335-f4bf-4d44-8166-0d4cf67e1926 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:43.582353 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-4ce81335-f4bf-4d44-8166-0d4cf67e1926 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:43.719892 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-4ce81335-f4bf-4d44-8166-0d4cf67e1926 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:56:43.727971 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-4ce81335-f4bf-4d44-8166-0d4cf67e1926 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b" status: 200 len: 1326 microversion: 2.1 time: 0.159148 Aug 02 10:56:43.728557 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 79/168] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:56:43 2022] GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b => generated 1326 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:56:44.598999 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-bce6ef58-0fd0-48fb-987f-8f6543e46b00 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:56:44.599703 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-bce6ef58-0fd0-48fb-987f-8f6543e46b00 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: b3a92fc5-5c44-48d1-8394-535687bb6ae3] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:56:44.606514 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-bce6ef58-0fd0-48fb-987f-8f6543e46b00 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:44.607148 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-bce6ef58-0fd0-48fb-987f-8f6543e46b00 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:44.608134 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-bce6ef58-0fd0-48fb-987f-8f6543e46b00 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:44.608594 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-bce6ef58-0fd0-48fb-987f-8f6543e46b00 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:44.750126 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-fa310e6a-63ce-4b41-a86a-b12872e8bba2 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:56:44.751469 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-fa310e6a-63ce-4b41-a86a-b12872e8bba2 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 454053f7-16a6-42c3-9ba0-ca0a40dc5c4b] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:56:44.759991 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-fa310e6a-63ce-4b41-a86a-b12872e8bba2 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:44.760651 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-fa310e6a-63ce-4b41-a86a-b12872e8bba2 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:44.762780 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-fa310e6a-63ce-4b41-a86a-b12872e8bba2 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:44.764450 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-fa310e6a-63ce-4b41-a86a-b12872e8bba2 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:44.855635 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-bce6ef58-0fd0-48fb-987f-8f6543e46b00 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:56:44.864608 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-bce6ef58-0fd0-48fb-987f-8f6543e46b00 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:56:44.866211 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-bce6ef58-0fd0-48fb-987f-8f6543e46b00 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:56:44.867794 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-bce6ef58-0fd0-48fb-987f-8f6543e46b00 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3" status: 200 len: 1728 microversion: 2.20 time: 0.272748 Aug 02 10:56:44.868470 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 90/169] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 10:56:44 2022] GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3 => generated 1728 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:56:44.923899 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-fa310e6a-63ce-4b41-a86a-b12872e8bba2 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:56:44.927366 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG dbcounter [-] [129952] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=129952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:56:44.931709 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-fa310e6a-63ce-4b41-a86a-b12872e8bba2 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b" status: 200 len: 1326 microversion: 2.1 time: 0.186463 Aug 02 10:56:44.932274 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 80/170] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:56:44 2022] GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b => generated 1326 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:56:45.893479 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-83908d20-49fe-4808-b511-7fdd99ebb911 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:56:45.894634 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-83908d20-49fe-4808-b511-7fdd99ebb911 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: b3a92fc5-5c44-48d1-8394-535687bb6ae3] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:56:45.902382 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-83908d20-49fe-4808-b511-7fdd99ebb911 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:45.902994 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-83908d20-49fe-4808-b511-7fdd99ebb911 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:45.903964 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-83908d20-49fe-4808-b511-7fdd99ebb911 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:45.904496 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-83908d20-49fe-4808-b511-7fdd99ebb911 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:45.933097 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG dbcounter [-] [129953] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:56:45.954503 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-b2a630d6-7f90-4422-afcf-244724fb1673 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:56:45.956336 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-b2a630d6-7f90-4422-afcf-244724fb1673 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 454053f7-16a6-42c3-9ba0-ca0a40dc5c4b] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:56:45.965606 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-b2a630d6-7f90-4422-afcf-244724fb1673 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:45.970118 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-b2a630d6-7f90-4422-afcf-244724fb1673 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:45.970118 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-b2a630d6-7f90-4422-afcf-244724fb1673 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:45.970118 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-b2a630d6-7f90-4422-afcf-244724fb1673 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:46.295663 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-83908d20-49fe-4808-b511-7fdd99ebb911 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:56:46.306011 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-83908d20-49fe-4808-b511-7fdd99ebb911 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:56:46.307530 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-83908d20-49fe-4808-b511-7fdd99ebb911 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:56:46.308681 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-83908d20-49fe-4808-b511-7fdd99ebb911 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3" status: 200 len: 1728 microversion: 2.20 time: 0.421055 Aug 02 10:56:46.309451 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 91/171] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 10:56:45 2022] GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3 => generated 1728 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:56:46.640759 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-b2a630d6-7f90-4422-afcf-244724fb1673 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:56:46.657076 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-b2a630d6-7f90-4422-afcf-244724fb1673 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b" status: 200 len: 1326 microversion: 2.1 time: 0.707860 Aug 02 10:56:46.657673 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 81/172] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:56:45 2022] GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b => generated 1326 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:56:47.336387 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-69019035-652f-4f0e-ad60-4df1f95da9c7 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:56:47.337799 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-69019035-652f-4f0e-ad60-4df1f95da9c7 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: b3a92fc5-5c44-48d1-8394-535687bb6ae3] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:56:47.348967 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-69019035-652f-4f0e-ad60-4df1f95da9c7 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:47.350116 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-69019035-652f-4f0e-ad60-4df1f95da9c7 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:47.351239 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-69019035-652f-4f0e-ad60-4df1f95da9c7 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:47.351982 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-69019035-652f-4f0e-ad60-4df1f95da9c7 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:47.651505 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-69019035-652f-4f0e-ad60-4df1f95da9c7 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:56:47.667814 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-69019035-652f-4f0e-ad60-4df1f95da9c7 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:56:47.678151 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-f71df3e6-5fc7-42d8-8e12-99154ddcbba1 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:56:47.679727 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-f71df3e6-5fc7-42d8-8e12-99154ddcbba1 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 454053f7-16a6-42c3-9ba0-ca0a40dc5c4b] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:56:47.685917 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-69019035-652f-4f0e-ad60-4df1f95da9c7 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:56:47.690361 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-69019035-652f-4f0e-ad60-4df1f95da9c7 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3" status: 200 len: 1728 microversion: 2.20 time: 0.359550 Aug 02 10:56:47.695433 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 92/173] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 10:56:47 2022] GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3 => generated 1728 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:56:47.698108 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-f71df3e6-5fc7-42d8-8e12-99154ddcbba1 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:47.698809 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-f71df3e6-5fc7-42d8-8e12-99154ddcbba1 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:47.699867 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-f71df3e6-5fc7-42d8-8e12-99154ddcbba1 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:47.701392 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-f71df3e6-5fc7-42d8-8e12-99154ddcbba1 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:47.970283 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-f71df3e6-5fc7-42d8-8e12-99154ddcbba1 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:56:47.979166 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-f71df3e6-5fc7-42d8-8e12-99154ddcbba1 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b" status: 200 len: 1326 microversion: 2.1 time: 0.305188 Aug 02 10:56:47.998749 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 82/174] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:56:47 2022] GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b => generated 1326 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:56:48.721531 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-05df93a5-ff84-4e9a-aaea-c495787a39b9 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:56:48.722149 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-05df93a5-ff84-4e9a-aaea-c495787a39b9 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: b3a92fc5-5c44-48d1-8394-535687bb6ae3] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:56:48.728880 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-05df93a5-ff84-4e9a-aaea-c495787a39b9 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:48.729539 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-05df93a5-ff84-4e9a-aaea-c495787a39b9 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:48.730544 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-05df93a5-ff84-4e9a-aaea-c495787a39b9 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:48.731220 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-05df93a5-ff84-4e9a-aaea-c495787a39b9 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:48.957935 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-05df93a5-ff84-4e9a-aaea-c495787a39b9 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:56:48.967958 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-05df93a5-ff84-4e9a-aaea-c495787a39b9 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:56:48.969805 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-05df93a5-ff84-4e9a-aaea-c495787a39b9 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:56:48.971287 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-05df93a5-ff84-4e9a-aaea-c495787a39b9 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3" status: 200 len: 1728 microversion: 2.20 time: 0.253536 Aug 02 10:56:48.972178 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 93/175] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 10:56:48 2022] GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3 => generated 1728 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:56:49.022138 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-9a8b3dc9-d11b-49d6-ae9d-73edf262a89f tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:56:49.023214 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-9a8b3dc9-d11b-49d6-ae9d-73edf262a89f tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 454053f7-16a6-42c3-9ba0-ca0a40dc5c4b] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:56:49.048998 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-9a8b3dc9-d11b-49d6-ae9d-73edf262a89f tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:49.049647 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-9a8b3dc9-d11b-49d6-ae9d-73edf262a89f tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:49.052512 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-9a8b3dc9-d11b-49d6-ae9d-73edf262a89f tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:49.052958 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-9a8b3dc9-d11b-49d6-ae9d-73edf262a89f tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:49.280798 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-9a8b3dc9-d11b-49d6-ae9d-73edf262a89f tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:56:49.289395 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-9a8b3dc9-d11b-49d6-ae9d-73edf262a89f tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b" status: 200 len: 1326 microversion: 2.1 time: 0.280832 Aug 02 10:56:49.290169 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 83/176] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:56:49 2022] GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b => generated 1326 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:56:49.644749 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-e49292a4-8335-48bd-a2f6-557cab860a8f tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Action: 'create', calling method: .version_select at 0x7f7c540a7c10>, body: {"keypair": {"name": "tempest-keypair-56915147", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHX9t5XhYv+4xvmxm6Yn12LEIyv41GfNZz/KNOhFvM421k1AahYbbxcwLZ60/MNx4kt5Ok6k/pF95dNzAVNYCMzkTGwvgAy2eLrPMdRG9LTan1H+BoiAYQj8v+QM0HgmXA=="}} {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:56:49.664377 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.quota [None req-e49292a4-8335-48bd-a2f6-557cab860a8f tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Getting quotas for project 89a4a0cf1852449e8bfc59ddb5a902c1. Resources: {'key_pairs'} {{(pid=129953) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 10:56:49.669508 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.quota [None req-e49292a4-8335-48bd-a2f6-557cab860a8f tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Getting quotas for user 53bc14ada1564911b2f0a698aef3f333 and project 89a4a0cf1852449e8bfc59ddb5a902c1. Resources: {'key_pairs'} {{(pid=129953) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 10:56:49.824668 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-e49292a4-8335-48bd-a2f6-557cab860a8f tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.184386 Aug 02 10:56:49.825288 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 94/177] 10.222.0.115 () {60 vars in 1164 bytes} [Tue Aug 2 10:56:49 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:56:49.995450 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-9ef4ef19-ba1a-444c-a2e2-a77cd2d8f4b8 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:56:49.996052 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-9ef4ef19-ba1a-444c-a2e2-a77cd2d8f4b8 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: b3a92fc5-5c44-48d1-8394-535687bb6ae3] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:56:50.010667 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-9ef4ef19-ba1a-444c-a2e2-a77cd2d8f4b8 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:50.014632 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-9ef4ef19-ba1a-444c-a2e2-a77cd2d8f4b8 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:50.019863 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-9ef4ef19-ba1a-444c-a2e2-a77cd2d8f4b8 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:50.019863 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-9ef4ef19-ba1a-444c-a2e2-a77cd2d8f4b8 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:50.226190 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-9ef4ef19-ba1a-444c-a2e2-a77cd2d8f4b8 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:56:50.236471 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-9ef4ef19-ba1a-444c-a2e2-a77cd2d8f4b8 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:56:50.238394 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-9ef4ef19-ba1a-444c-a2e2-a77cd2d8f4b8 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:56:50.239731 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-9ef4ef19-ba1a-444c-a2e2-a77cd2d8f4b8 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3" status: 200 len: 1728 microversion: 2.20 time: 0.248121 Aug 02 10:56:50.257930 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 84/178] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 10:56:49 2022] GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3 => generated 1728 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:56:50.312229 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-bc7a4d98-921f-489e-bb25-256c74f9eebe tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:56:50.312579 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-bc7a4d98-921f-489e-bb25-256c74f9eebe tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 454053f7-16a6-42c3-9ba0-ca0a40dc5c4b] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:56:50.321963 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-bc7a4d98-921f-489e-bb25-256c74f9eebe tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:50.325043 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-bc7a4d98-921f-489e-bb25-256c74f9eebe tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:50.325043 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-bc7a4d98-921f-489e-bb25-256c74f9eebe tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:50.325043 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-bc7a4d98-921f-489e-bb25-256c74f9eebe tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:50.636814 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-bc7a4d98-921f-489e-bb25-256c74f9eebe tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:56:50.657658 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-bc7a4d98-921f-489e-bb25-256c74f9eebe tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b" status: 200 len: 1326 microversion: 2.1 time: 0.350221 Aug 02 10:56:50.671452 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 95/179] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:56:50 2022] GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b => generated 1326 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:56:51.272520 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-cfcbd7bc-02d5-4bc0-b63f-8dc815e939af tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:56:51.273248 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-cfcbd7bc-02d5-4bc0-b63f-8dc815e939af tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: b3a92fc5-5c44-48d1-8394-535687bb6ae3] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:56:51.281209 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-cfcbd7bc-02d5-4bc0-b63f-8dc815e939af tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:51.281661 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-cfcbd7bc-02d5-4bc0-b63f-8dc815e939af tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:51.282436 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-cfcbd7bc-02d5-4bc0-b63f-8dc815e939af tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:51.283001 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-cfcbd7bc-02d5-4bc0-b63f-8dc815e939af tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:51.366819 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-78fd2154-ad6e-4ce5-9adb-2433136492e1 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Action: 'create', calling method: .version_select at 0x7f7c4ef67280>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1578588330", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAa0U55AChoe3cAedem/dSuqmoEqAUPIcj317koCxwY04CO1KPlIJ/BbWIHuDAWwkUr3oUwkAfNCQoeaa7RFEr5EJdOAb3L4N4J/78heSCk2vZ+ggH8RdTRqB4sjyTX/sw=="}} {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:56:51.379162 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.quota [None req-78fd2154-ad6e-4ce5-9adb-2433136492e1 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Getting quotas for project be66234794284419a47e3afcae968084. Resources: {'key_pairs'} {{(pid=129952) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 10:56:51.383516 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.quota [None req-78fd2154-ad6e-4ce5-9adb-2433136492e1 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Getting quotas for user 914de37664914b4cb91e0ce2c3a0e1d1 and project be66234794284419a47e3afcae968084. Resources: {'key_pairs'} {{(pid=129952) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 10:56:51.428593 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-cfcbd7bc-02d5-4bc0-b63f-8dc815e939af tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:56:51.437616 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-cfcbd7bc-02d5-4bc0-b63f-8dc815e939af tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:56:51.440927 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-cfcbd7bc-02d5-4bc0-b63f-8dc815e939af tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:56:51.440927 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-cfcbd7bc-02d5-4bc0-b63f-8dc815e939af tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3" status: 200 len: 1728 microversion: 2.20 time: 0.179276 Aug 02 10:56:51.440927 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 96/180] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 10:56:51 2022] GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3 => generated 1728 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:56:51.498526 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-78fd2154-ad6e-4ce5-9adb-2433136492e1 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] 10.222.0.115 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.321274 Aug 02 10:56:51.499167 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 85/181] 10.222.0.115 () {60 vars in 1164 bytes} [Tue Aug 2 10:56:51 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:56:51.683621 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-6fe2f76f-abf5-409c-9488-64c4af88f7ae tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:56:51.684840 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-6fe2f76f-abf5-409c-9488-64c4af88f7ae tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 454053f7-16a6-42c3-9ba0-ca0a40dc5c4b] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:56:51.687934 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG dbcounter [-] [129953] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=7 {{(pid=129953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:56:51.692830 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-6fe2f76f-abf5-409c-9488-64c4af88f7ae tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:51.695167 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-6fe2f76f-abf5-409c-9488-64c4af88f7ae tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:51.696185 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-6fe2f76f-abf5-409c-9488-64c4af88f7ae tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:51.697367 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-6fe2f76f-abf5-409c-9488-64c4af88f7ae tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:51.854879 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-6fe2f76f-abf5-409c-9488-64c4af88f7ae tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:56:51.862916 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-6fe2f76f-abf5-409c-9488-64c4af88f7ae tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b" status: 200 len: 1326 microversion: 2.1 time: 0.183770 Aug 02 10:56:51.863525 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 97/182] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:56:51 2022] GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b => generated 1326 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:56:52.465375 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-cae7eb2c-e4e0-48a3-81b0-f4948d540cbd tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:56:52.467979 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-cae7eb2c-e4e0-48a3-81b0-f4948d540cbd tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: b3a92fc5-5c44-48d1-8394-535687bb6ae3] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:56:52.480335 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-cae7eb2c-e4e0-48a3-81b0-f4948d540cbd tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:52.480793 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-cae7eb2c-e4e0-48a3-81b0-f4948d540cbd tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:52.482396 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-cae7eb2c-e4e0-48a3-81b0-f4948d540cbd tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:52.482996 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-cae7eb2c-e4e0-48a3-81b0-f4948d540cbd tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:52.677303 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-cae7eb2c-e4e0-48a3-81b0-f4948d540cbd tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:56:52.687379 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-cae7eb2c-e4e0-48a3-81b0-f4948d540cbd tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:56:52.689499 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-cae7eb2c-e4e0-48a3-81b0-f4948d540cbd tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:56:52.691209 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-cae7eb2c-e4e0-48a3-81b0-f4948d540cbd tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3" status: 200 len: 1728 microversion: 2.20 time: 0.230301 Aug 02 10:56:52.691958 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 86/183] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 10:56:52 2022] GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3 => generated 1728 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:56:52.701457 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-f391a9af-942d-4af8-b3c5-1ea2475a5e54 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1441471646", "imageRef": "aa0a7b8c-0dd6-4803-8767-cb8c2d05fdd4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "aafffa4e-4cec-4281-b3a0-ebe26470b35c"}], "security_groups": [{"name": "tempest-securitygroup--1373227636"}], "key_name": "tempest-keypair-56915147", "user_data": "}} {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:56:52.832921 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.network.neutron [None req-f391a9af-942d-4af8-b3c5-1ea2475a5e54 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] validate_networks() for [('aafffa4e-4cec-4281-b3a0-ebe26470b35c', None, None, None, None, None)] {{(pid=129953) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 10:56:52.884913 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-eef07e16-f5d3-4503-877a-a2ebba184a9a tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:56:52.885525 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-eef07e16-f5d3-4503-877a-a2ebba184a9a tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 454053f7-16a6-42c3-9ba0-ca0a40dc5c4b] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:56:52.894707 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-eef07e16-f5d3-4503-877a-a2ebba184a9a tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:52.894707 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-eef07e16-f5d3-4503-877a-a2ebba184a9a tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:52.894707 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-eef07e16-f5d3-4503-877a-a2ebba184a9a tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:52.894707 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-eef07e16-f5d3-4503-877a-a2ebba184a9a tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:53.111196 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-eef07e16-f5d3-4503-877a-a2ebba184a9a tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:56:53.119663 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-eef07e16-f5d3-4503-877a-a2ebba184a9a tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b" status: 200 len: 1326 microversion: 2.1 time: 0.239253 Aug 02 10:56:53.133938 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 87/184] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:56:52 2022] GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b => generated 1326 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:56:53.378550 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.virt.hardware [None req-f391a9af-942d-4af8-b3c5-1ea2475a5e54 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Flavor limits 0:0:0 {{(pid=129953) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 10:56:53.378974 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.virt.hardware [None req-f391a9af-942d-4af8-b3c5-1ea2475a5e54 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Image limits 0:0:0 {{(pid=129953) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 10:56:53.379769 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.virt.hardware [None req-f391a9af-942d-4af8-b3c5-1ea2475a5e54 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Flavor pref 0:0:0 {{(pid=129953) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 10:56:53.380441 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.virt.hardware [None req-f391a9af-942d-4af8-b3c5-1ea2475a5e54 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Image pref 0:0:0 {{(pid=129953) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 10:56:53.380887 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.virt.hardware [None req-f391a9af-942d-4af8-b3c5-1ea2475a5e54 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129953) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 10:56:53.400415 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-f391a9af-942d-4af8-b3c5-1ea2475a5e54 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:53.401051 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-f391a9af-942d-4af8-b3c5-1ea2475a5e54 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:53.402101 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-f391a9af-942d-4af8-b3c5-1ea2475a5e54 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:53.402541 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-f391a9af-942d-4af8-b3c5-1ea2475a5e54 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:53.434177 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.quota [None req-f391a9af-942d-4af8-b3c5-1ea2475a5e54 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Getting quotas for project 89a4a0cf1852449e8bfc59ddb5a902c1. Resources: {'instances', 'cores', 'ram'} {{(pid=129953) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 10:56:53.447040 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.quota [None req-f391a9af-942d-4af8-b3c5-1ea2475a5e54 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Getting quotas for user 53bc14ada1564911b2f0a698aef3f333 and project 89a4a0cf1852449e8bfc59ddb5a902c1. Resources: {'instances', 'cores', 'ram'} {{(pid=129953) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 10:56:53.478791 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-f391a9af-942d-4af8-b3c5-1ea2475a5e54 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Going to run 1 instances... {{(pid=129953) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 10:56:53.481151 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-f391a9af-942d-4af8-b3c5-1ea2475a5e54 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: 9a2aa113-3a93-47a7-8b8f-82761ec366e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aa0a7b8c-0dd6-4803-8767-cb8c2d05fdd4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129953) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 10:56:53.662447 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-f391a9af-942d-4af8-b3c5-1ea2475a5e54 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.965502 Aug 02 10:56:53.663544 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 98/185] 10.222.0.115 () {60 vars in 1152 bytes} [Tue Aug 2 10:56:52 2022] POST /compute/v2.1/servers => generated 404 bytes in 968 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 02 10:56:53.684923 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-2c4ee8c2-d3b6-42f1-ac62-a2c148362e86 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:56:53.686813 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-2c4ee8c2-d3b6-42f1-ac62-a2c148362e86 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: 9a2aa113-3a93-47a7-8b8f-82761ec366e5] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:56:53.716802 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-48f31194-658e-47c9-bdba-093fe9955b07 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:56:53.718801 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-48f31194-658e-47c9-bdba-093fe9955b07 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: b3a92fc5-5c44-48d1-8394-535687bb6ae3] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:56:53.726980 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-48f31194-658e-47c9-bdba-093fe9955b07 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:53.727712 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-48f31194-658e-47c9-bdba-093fe9955b07 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:53.728707 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-48f31194-658e-47c9-bdba-093fe9955b07 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:53.729307 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-48f31194-658e-47c9-bdba-093fe9955b07 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:53.766376 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-2c4ee8c2-d3b6-42f1-ac62-a2c148362e86 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bc14ada1564911b2f0a698aef3f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a4a0cf1852449e8bfc59ddb5a902c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:56:53.776303 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-2c4ee8c2-d3b6-42f1-ac62-a2c148362e86 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "GET /compute/v2.1/servers/9a2aa113-3a93-47a7-8b8f-82761ec366e5" status: 200 len: 1244 microversion: 2.1 time: 0.104723 Aug 02 10:56:53.792085 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 88/186] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:56:53 2022] GET /compute/v2.1/servers/9a2aa113-3a93-47a7-8b8f-82761ec366e5 => generated 1244 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:56:53.925269 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-48f31194-658e-47c9-bdba-093fe9955b07 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:56:53.935413 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-48f31194-658e-47c9-bdba-093fe9955b07 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:56:53.937504 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-48f31194-658e-47c9-bdba-093fe9955b07 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:56:53.938926 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-48f31194-658e-47c9-bdba-093fe9955b07 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3" status: 200 len: 1728 microversion: 2.20 time: 0.226580 Aug 02 10:56:53.939746 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 99/187] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 10:56:53 2022] GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3 => generated 1728 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:56:54.144781 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-6f416783-0633-4a32-87da-f4e5c072a620 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:56:54.145424 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-6f416783-0633-4a32-87da-f4e5c072a620 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 454053f7-16a6-42c3-9ba0-ca0a40dc5c4b] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:56:54.154462 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-6f416783-0633-4a32-87da-f4e5c072a620 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:54.154842 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-6f416783-0633-4a32-87da-f4e5c072a620 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:54.155623 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-6f416783-0633-4a32-87da-f4e5c072a620 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:54.156064 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-6f416783-0633-4a32-87da-f4e5c072a620 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:54.442310 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-6f416783-0633-4a32-87da-f4e5c072a620 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:56:54.454074 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-6f416783-0633-4a32-87da-f4e5c072a620 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b" status: 200 len: 1520 microversion: 2.1 time: 0.315836 Aug 02 10:56:54.454074 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 89/188] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:56:54 2022] GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b => generated 1520 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:56:54.477479 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-24344119-7dd6-4471-98ff-38665528ad0f tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:56:54.480221 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-24344119-7dd6-4471-98ff-38665528ad0f tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 454053f7-16a6-42c3-9ba0-ca0a40dc5c4b] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:56:54.499327 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-24344119-7dd6-4471-98ff-38665528ad0f tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:54.499800 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-24344119-7dd6-4471-98ff-38665528ad0f tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:54.503861 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-24344119-7dd6-4471-98ff-38665528ad0f tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:54.504882 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-24344119-7dd6-4471-98ff-38665528ad0f tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:54.551485 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.objects.instance [None req-24344119-7dd6-4471-98ff-38665528ad0f tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lazy-loading 'flavor' on Instance uuid 454053f7-16a6-42c3-9ba0-ca0a40dc5c4b {{(pid=129953) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 10:56:54.806022 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-7cc25ffc-a624-4bc1-9a27-7f73ff12aefc tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:56:54.807313 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-7cc25ffc-a624-4bc1-9a27-7f73ff12aefc tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: 9a2aa113-3a93-47a7-8b8f-82761ec366e5] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:56:54.899475 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-7cc25ffc-a624-4bc1-9a27-7f73ff12aefc tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bc14ada1564911b2f0a698aef3f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a4a0cf1852449e8bfc59ddb5a902c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:56:54.908417 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-7cc25ffc-a624-4bc1-9a27-7f73ff12aefc tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "GET /compute/v2.1/servers/9a2aa113-3a93-47a7-8b8f-82761ec366e5" status: 200 len: 1244 microversion: 2.1 time: 0.106422 Aug 02 10:56:54.911608 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 90/189] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:56:54 2022] GET /compute/v2.1/servers/9a2aa113-3a93-47a7-8b8f-82761ec366e5 => generated 1244 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:56:54.961933 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-0fb00258-10b9-4b68-a83b-9fef852c62aa tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:56:54.962902 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-0fb00258-10b9-4b68-a83b-9fef852c62aa tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: b3a92fc5-5c44-48d1-8394-535687bb6ae3] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:56:54.976602 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-0fb00258-10b9-4b68-a83b-9fef852c62aa tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:54.976602 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-0fb00258-10b9-4b68-a83b-9fef852c62aa tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:54.976602 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-0fb00258-10b9-4b68-a83b-9fef852c62aa tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:54.976602 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-0fb00258-10b9-4b68-a83b-9fef852c62aa tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:55.028669 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-24344119-7dd6-4471-98ff-38665528ad0f tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "POST /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b/action" status: 200 len: 32 microversion: 2.1 time: 0.554130 Aug 02 10:56:55.031852 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 100/190] 10.222.0.115 () {60 vars in 1283 bytes} [Tue Aug 2 10:56:54 2022] POST /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b/action => generated 32 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 10:56:55.052261 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-19801b7f-f4c7-402d-b4dc-598168a81c5d tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:56:55.053083 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-19801b7f-f4c7-402d-b4dc-598168a81c5d tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 454053f7-16a6-42c3-9ba0-ca0a40dc5c4b] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:56:55.060548 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-19801b7f-f4c7-402d-b4dc-598168a81c5d tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:55.061072 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-19801b7f-f4c7-402d-b4dc-598168a81c5d tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:55.061920 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-19801b7f-f4c7-402d-b4dc-598168a81c5d tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:55.062433 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-19801b7f-f4c7-402d-b4dc-598168a81c5d tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:55.215376 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-0fb00258-10b9-4b68-a83b-9fef852c62aa tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:56:55.226882 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-0fb00258-10b9-4b68-a83b-9fef852c62aa tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:56:55.228464 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-0fb00258-10b9-4b68-a83b-9fef852c62aa tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:56:55.229854 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-0fb00258-10b9-4b68-a83b-9fef852c62aa tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3" status: 200 len: 1728 microversion: 2.20 time: 0.272054 Aug 02 10:56:55.230414 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 91/191] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 10:56:54 2022] GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3 => generated 1728 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:56:55.259539 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-19801b7f-f4c7-402d-b4dc-598168a81c5d tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:56:55.268369 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-19801b7f-f4c7-402d-b4dc-598168a81c5d tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b" status: 200 len: 1526 microversion: 2.1 time: 0.220688 Aug 02 10:56:55.268931 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 101/192] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:56:55 2022] GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b => generated 1526 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:56:55.941249 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-b7cfd876-ccca-4522-a3cb-2457628b9595 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:56:55.942003 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-b7cfd876-ccca-4522-a3cb-2457628b9595 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: 9a2aa113-3a93-47a7-8b8f-82761ec366e5] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:56:55.945387 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG dbcounter [-] [129952] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=1 {{(pid=129952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:56:55.948986 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-b7cfd876-ccca-4522-a3cb-2457628b9595 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:55.949437 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-b7cfd876-ccca-4522-a3cb-2457628b9595 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:55.957280 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-b7cfd876-ccca-4522-a3cb-2457628b9595 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:55.959094 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-b7cfd876-ccca-4522-a3cb-2457628b9595 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:56.031458 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-b7cfd876-ccca-4522-a3cb-2457628b9595 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bc14ada1564911b2f0a698aef3f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a4a0cf1852449e8bfc59ddb5a902c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:56:56.041853 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-b7cfd876-ccca-4522-a3cb-2457628b9595 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "GET /compute/v2.1/servers/9a2aa113-3a93-47a7-8b8f-82761ec366e5" status: 200 len: 1296 microversion: 2.1 time: 0.104270 Aug 02 10:56:56.043495 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 92/193] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:56:55 2022] GET /compute/v2.1/servers/9a2aa113-3a93-47a7-8b8f-82761ec366e5 => generated 1296 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:56:56.254489 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-3064e097-f0cb-47b0-9789-83b0fe1182bd tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:56:56.255949 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-3064e097-f0cb-47b0-9789-83b0fe1182bd tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: b3a92fc5-5c44-48d1-8394-535687bb6ae3] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:56:56.263107 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-3064e097-f0cb-47b0-9789-83b0fe1182bd tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:56.263560 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-3064e097-f0cb-47b0-9789-83b0fe1182bd tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:56.264347 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-3064e097-f0cb-47b0-9789-83b0fe1182bd tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:56.264973 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-3064e097-f0cb-47b0-9789-83b0fe1182bd tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:56.290588 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-61ce06e7-22da-4aed-b002-89e33e20c55f tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:56:56.291411 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-61ce06e7-22da-4aed-b002-89e33e20c55f tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 454053f7-16a6-42c3-9ba0-ca0a40dc5c4b] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:56:56.299718 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-61ce06e7-22da-4aed-b002-89e33e20c55f tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:56.300281 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-61ce06e7-22da-4aed-b002-89e33e20c55f tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:56.301027 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-61ce06e7-22da-4aed-b002-89e33e20c55f tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:56.301462 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-61ce06e7-22da-4aed-b002-89e33e20c55f tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:56.523387 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-3064e097-f0cb-47b0-9789-83b0fe1182bd tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:56:56.541422 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-3064e097-f0cb-47b0-9789-83b0fe1182bd tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:56:56.543389 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-3064e097-f0cb-47b0-9789-83b0fe1182bd tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:56:56.549983 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-3064e097-f0cb-47b0-9789-83b0fe1182bd tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3" status: 200 len: 1728 microversion: 2.20 time: 0.294477 Aug 02 10:56:56.550650 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 102/194] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 10:56:56 2022] GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3 => generated 1728 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:56:56.563245 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-61ce06e7-22da-4aed-b002-89e33e20c55f tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:56:56.566435 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-61ce06e7-22da-4aed-b002-89e33e20c55f tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b" status: 200 len: 1526 microversion: 2.1 time: 0.278540 Aug 02 10:56:56.568814 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 93/195] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:56:56 2022] GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b => generated 1526 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:56:57.073032 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-e76006df-2d31-4633-8fb4-de0e1817ae37 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:56:57.073757 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-e76006df-2d31-4633-8fb4-de0e1817ae37 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: 9a2aa113-3a93-47a7-8b8f-82761ec366e5] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:56:57.083240 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-e76006df-2d31-4633-8fb4-de0e1817ae37 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:57.083684 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-e76006df-2d31-4633-8fb4-de0e1817ae37 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:57.084499 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-e76006df-2d31-4633-8fb4-de0e1817ae37 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:57.084980 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-e76006df-2d31-4633-8fb4-de0e1817ae37 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:57.169114 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-e76006df-2d31-4633-8fb4-de0e1817ae37 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bc14ada1564911b2f0a698aef3f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a4a0cf1852449e8bfc59ddb5a902c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:56:57.180873 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-e76006df-2d31-4633-8fb4-de0e1817ae37 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "GET /compute/v2.1/servers/9a2aa113-3a93-47a7-8b8f-82761ec366e5" status: 200 len: 1302 microversion: 2.1 time: 0.114002 Aug 02 10:56:57.180873 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 103/196] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:56:57 2022] GET /compute/v2.1/servers/9a2aa113-3a93-47a7-8b8f-82761ec366e5 => generated 1302 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:56:57.575460 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-b2e8cb48-dd12-4638-b16a-cc7e313f05ce tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:56:57.576751 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-b2e8cb48-dd12-4638-b16a-cc7e313f05ce tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: b3a92fc5-5c44-48d1-8394-535687bb6ae3] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:56:57.585320 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-b2e8cb48-dd12-4638-b16a-cc7e313f05ce tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:57.586222 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-b2e8cb48-dd12-4638-b16a-cc7e313f05ce tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:57.587393 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-b2e8cb48-dd12-4638-b16a-cc7e313f05ce tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:57.588124 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-b2e8cb48-dd12-4638-b16a-cc7e313f05ce tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:57.594852 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-e4c81cfc-3879-49aa-bcd8-4b7f47e45d09 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:56:57.596278 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-e4c81cfc-3879-49aa-bcd8-4b7f47e45d09 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 454053f7-16a6-42c3-9ba0-ca0a40dc5c4b] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:56:57.611015 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-e4c81cfc-3879-49aa-bcd8-4b7f47e45d09 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:57.613109 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-e4c81cfc-3879-49aa-bcd8-4b7f47e45d09 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:57.615981 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-e4c81cfc-3879-49aa-bcd8-4b7f47e45d09 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:57.616516 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-e4c81cfc-3879-49aa-bcd8-4b7f47e45d09 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:57.958234 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-e4c81cfc-3879-49aa-bcd8-4b7f47e45d09 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:56:57.966797 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-e4c81cfc-3879-49aa-bcd8-4b7f47e45d09 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b" status: 200 len: 1526 microversion: 2.1 time: 0.376755 Aug 02 10:56:57.978659 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-b2e8cb48-dd12-4638-b16a-cc7e313f05ce tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:56:57.979557 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 104/197] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:56:57 2022] GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b => generated 1526 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:56:57.990890 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-b2e8cb48-dd12-4638-b16a-cc7e313f05ce tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:56:57.993466 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-b2e8cb48-dd12-4638-b16a-cc7e313f05ce tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:56:57.996064 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-b2e8cb48-dd12-4638-b16a-cc7e313f05ce tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3" status: 200 len: 1728 microversion: 2.20 time: 0.425807 Aug 02 10:56:57.998195 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 94/198] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 10:56:57 2022] GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3 => generated 1728 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:56:58.204993 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-8ce4258b-e0df-41f5-84e7-fb49aec3dc4d tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:56:58.205613 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-8ce4258b-e0df-41f5-84e7-fb49aec3dc4d tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: 9a2aa113-3a93-47a7-8b8f-82761ec366e5] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:56:58.214923 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-8ce4258b-e0df-41f5-84e7-fb49aec3dc4d tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:58.215437 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-8ce4258b-e0df-41f5-84e7-fb49aec3dc4d tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:58.216220 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-8ce4258b-e0df-41f5-84e7-fb49aec3dc4d tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:58.216657 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-8ce4258b-e0df-41f5-84e7-fb49aec3dc4d tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:58.509115 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-8ce4258b-e0df-41f5-84e7-fb49aec3dc4d tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bc14ada1564911b2f0a698aef3f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a4a0cf1852449e8bfc59ddb5a902c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:56:58.529936 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-8ce4258b-e0df-41f5-84e7-fb49aec3dc4d tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "GET /compute/v2.1/servers/9a2aa113-3a93-47a7-8b8f-82761ec366e5" status: 200 len: 1370 microversion: 2.1 time: 0.330572 Aug 02 10:56:58.530961 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 105/199] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:56:58 2022] GET /compute/v2.1/servers/9a2aa113-3a93-47a7-8b8f-82761ec366e5 => generated 1370 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:56:58.571470 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [req-f51e3b77-6b1f-49e8-8b20-e88cdf409bb0 req-c02233f1-1117-41f9-9dbb-1a30e0511a5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a2aa113-3a93-47a7-8b8f-82761ec366e5", "tag": "c5e050fb-f15e-4f37-af10-39c26d5ad028"}]} {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:56:58.582505 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [req-f51e3b77-6b1f-49e8-8b20-e88cdf409bb0 req-c02233f1-1117-41f9-9dbb-1a30e0511a5c service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:58.583141 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [req-f51e3b77-6b1f-49e8-8b20-e88cdf409bb0 req-c02233f1-1117-41f9-9dbb-1a30e0511a5c service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:58.594934 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.compute.server_external_events [req-f51e3b77-6b1f-49e8-8b20-e88cdf409bb0 req-c02233f1-1117-41f9-9dbb-1a30e0511a5c service nova] Creating event network-changed:c5e050fb-f15e-4f37-af10-39c26d5ad028 for instance 9a2aa113-3a93-47a7-8b8f-82761ec366e5 on hv-cinder-85031 Aug 02 10:56:58.599964 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [req-f51e3b77-6b1f-49e8-8b20-e88cdf409bb0 req-c02233f1-1117-41f9-9dbb-1a30e0511a5c service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032114 Aug 02 10:56:58.600648 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 95/200] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Aug 2 10:56:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:56:58.991353 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-f0ee107c-99a3-40b3-b55c-e754345c793c tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:56:58.991967 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-f0ee107c-99a3-40b3-b55c-e754345c793c tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 454053f7-16a6-42c3-9ba0-ca0a40dc5c4b] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:56:58.999471 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-f0ee107c-99a3-40b3-b55c-e754345c793c tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:58.999922 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-f0ee107c-99a3-40b3-b55c-e754345c793c tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:59.000688 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-f0ee107c-99a3-40b3-b55c-e754345c793c tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:59.001124 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-f0ee107c-99a3-40b3-b55c-e754345c793c tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:59.022658 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-4d878555-0375-4332-8ace-a340f6535efc tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:56:59.023549 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-4d878555-0375-4332-8ace-a340f6535efc tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: b3a92fc5-5c44-48d1-8394-535687bb6ae3] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:56:59.031406 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-4d878555-0375-4332-8ace-a340f6535efc tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:59.031856 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-4d878555-0375-4332-8ace-a340f6535efc tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:59.032647 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-4d878555-0375-4332-8ace-a340f6535efc tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:59.033866 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-4d878555-0375-4332-8ace-a340f6535efc tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:59.223501 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-f0ee107c-99a3-40b3-b55c-e754345c793c tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:56:59.230043 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-4d878555-0375-4332-8ace-a340f6535efc tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:56:59.232314 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-f0ee107c-99a3-40b3-b55c-e754345c793c tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b" status: 200 len: 1526 microversion: 2.1 time: 0.245118 Aug 02 10:56:59.233152 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 106/201] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:56:58 2022] GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b => generated 1526 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:56:59.238709 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-4d878555-0375-4332-8ace-a340f6535efc tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:56:59.240243 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-4d878555-0375-4332-8ace-a340f6535efc tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:56:59.241392 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-4d878555-0375-4332-8ace-a340f6535efc tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3" status: 200 len: 1728 microversion: 2.20 time: 0.223583 Aug 02 10:56:59.261998 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 96/202] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 10:56:59 2022] GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3 => generated 1728 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:56:59.553240 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-949e0b08-8704-4b07-ac5c-ff44ccebe597 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:56:59.553844 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-949e0b08-8704-4b07-ac5c-ff44ccebe597 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: 9a2aa113-3a93-47a7-8b8f-82761ec366e5] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:56:59.560664 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-949e0b08-8704-4b07-ac5c-ff44ccebe597 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:59.561104 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-949e0b08-8704-4b07-ac5c-ff44ccebe597 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:59.561869 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-949e0b08-8704-4b07-ac5c-ff44ccebe597 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:56:59.562418 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-949e0b08-8704-4b07-ac5c-ff44ccebe597 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:56:59.700723 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-949e0b08-8704-4b07-ac5c-ff44ccebe597 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bc14ada1564911b2f0a698aef3f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a4a0cf1852449e8bfc59ddb5a902c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:56:59.704516 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG dbcounter [-] [129953] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:56:59.709083 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-949e0b08-8704-4b07-ac5c-ff44ccebe597 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "GET /compute/v2.1/servers/9a2aa113-3a93-47a7-8b8f-82761ec366e5" status: 200 len: 1370 microversion: 2.1 time: 0.159668 Aug 02 10:56:59.716005 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 107/203] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:56:59 2022] GET /compute/v2.1/servers/9a2aa113-3a93-47a7-8b8f-82761ec366e5 => generated 1370 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:57:00.256064 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-77508537-c398-49dd-9eee-829c7ac59512 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:00.257411 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-77508537-c398-49dd-9eee-829c7ac59512 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 454053f7-16a6-42c3-9ba0-ca0a40dc5c4b] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:00.268086 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-d9a149cf-48d5-4bf0-9224-6a9729d6c88c tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:00.269206 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-d9a149cf-48d5-4bf0-9224-6a9729d6c88c tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: b3a92fc5-5c44-48d1-8394-535687bb6ae3] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:00.279887 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-d9a149cf-48d5-4bf0-9224-6a9729d6c88c tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:00.280506 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-d9a149cf-48d5-4bf0-9224-6a9729d6c88c tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:00.281226 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-77508537-c398-49dd-9eee-829c7ac59512 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:00.281590 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-d9a149cf-48d5-4bf0-9224-6a9729d6c88c tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:00.281693 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-77508537-c398-49dd-9eee-829c7ac59512 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:00.287933 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-d9a149cf-48d5-4bf0-9224-6a9729d6c88c tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:00.288117 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-77508537-c398-49dd-9eee-829c7ac59512 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:00.288117 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-77508537-c398-49dd-9eee-829c7ac59512 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:00.601137 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-d9a149cf-48d5-4bf0-9224-6a9729d6c88c tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:00.612326 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-d9a149cf-48d5-4bf0-9224-6a9729d6c88c tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:00.614721 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-d9a149cf-48d5-4bf0-9224-6a9729d6c88c tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:00.615770 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-77508537-c398-49dd-9eee-829c7ac59512 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:00.616920 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-d9a149cf-48d5-4bf0-9224-6a9729d6c88c tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3" status: 200 len: 1728 microversion: 2.20 time: 0.354972 Aug 02 10:57:00.617494 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 108/204] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 10:57:00 2022] GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3 => generated 1728 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:57:00.627875 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-77508537-c398-49dd-9eee-829c7ac59512 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b" status: 200 len: 1526 microversion: 2.1 time: 0.375125 Aug 02 10:57:00.629256 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 97/205] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:57:00 2022] GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b => generated 1526 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:57:00.731701 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-f0ffa6f2-9bbc-46ac-8a60-00b77f82cd6e tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:00.732437 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-f0ffa6f2-9bbc-46ac-8a60-00b77f82cd6e tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: 9a2aa113-3a93-47a7-8b8f-82761ec366e5] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:00.738766 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-f0ffa6f2-9bbc-46ac-8a60-00b77f82cd6e tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:00.739310 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-f0ffa6f2-9bbc-46ac-8a60-00b77f82cd6e tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:00.740082 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-f0ffa6f2-9bbc-46ac-8a60-00b77f82cd6e tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:00.740547 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-f0ffa6f2-9bbc-46ac-8a60-00b77f82cd6e tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:00.900385 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-f0ffa6f2-9bbc-46ac-8a60-00b77f82cd6e tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bc14ada1564911b2f0a698aef3f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a4a0cf1852449e8bfc59ddb5a902c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:00.908515 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-f0ffa6f2-9bbc-46ac-8a60-00b77f82cd6e tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "GET /compute/v2.1/servers/9a2aa113-3a93-47a7-8b8f-82761ec366e5" status: 200 len: 1370 microversion: 2.1 time: 0.181412 Aug 02 10:57:00.909106 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 109/206] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:57:00 2022] GET /compute/v2.1/servers/9a2aa113-3a93-47a7-8b8f-82761ec366e5 => generated 1370 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:57:01.544942 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-543aabef-b8c2-4975-8aa9-2ba7147cf582 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:57:01.551625 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-543aabef-b8c2-4975-8aa9-2ba7147cf582 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:01.552076 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-543aabef-b8c2-4975-8aa9-2ba7147cf582 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:01.616967 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-543aabef-b8c2-4975-8aa9-2ba7147cf582 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] [instance: 3938932a-e778-4c0c-9ab0-78dc9082a48e] Going to try to stop instance {{(pid=129952) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 02 10:57:01.652211 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-c558962c-4401-4dfe-a55c-1a3bfc60d3da tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:01.654079 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-c558962c-4401-4dfe-a55c-1a3bfc60d3da tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: b3a92fc5-5c44-48d1-8394-535687bb6ae3] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:01.662239 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-c558962c-4401-4dfe-a55c-1a3bfc60d3da tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:01.662692 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-c558962c-4401-4dfe-a55c-1a3bfc60d3da tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:01.663526 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-c558962c-4401-4dfe-a55c-1a3bfc60d3da tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:01.663964 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-c558962c-4401-4dfe-a55c-1a3bfc60d3da tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:01.819647 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-c558962c-4401-4dfe-a55c-1a3bfc60d3da tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:01.828116 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-c558962c-4401-4dfe-a55c-1a3bfc60d3da tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:01.829624 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-c558962c-4401-4dfe-a55c-1a3bfc60d3da tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:01.830786 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-c558962c-4401-4dfe-a55c-1a3bfc60d3da tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3" status: 200 len: 1749 microversion: 2.20 time: 0.192146 Aug 02 10:57:01.831433 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 110/207] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 10:57:01 2022] GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3 => generated 1749 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:57:01.835764 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-a7ad78df-7a60-476b-9461-4e3416844c97 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:01.836358 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-a7ad78df-7a60-476b-9461-4e3416844c97 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 454053f7-16a6-42c3-9ba0-ca0a40dc5c4b] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:01.843007 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-a7ad78df-7a60-476b-9461-4e3416844c97 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:01.843483 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-a7ad78df-7a60-476b-9461-4e3416844c97 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:01.844276 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-a7ad78df-7a60-476b-9461-4e3416844c97 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:01.844711 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-a7ad78df-7a60-476b-9461-4e3416844c97 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:01.992462 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-543aabef-b8c2-4975-8aa9-2ba7147cf582 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] 10.222.0.115 "POST /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e/action" status: 202 len: 0 microversion: 2.1 time: 0.451302 Aug 02 10:57:01.993810 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-a7ad78df-7a60-476b-9461-4e3416844c97 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:01.996678 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 98/208] 10.222.0.115 () {60 vars in 1283 bytes} [Tue Aug 2 10:57:01 2022] POST /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e/action => generated 0 bytes in 456 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 10:57:02.002641 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-335ebd3c-2754-4991-843b-f45fb58f1036 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:02.002891 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-a7ad78df-7a60-476b-9461-4e3416844c97 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b" status: 200 len: 1526 microversion: 2.1 time: 0.170441 Aug 02 10:57:02.003711 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-335ebd3c-2754-4991-843b-f45fb58f1036 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: 9a2aa113-3a93-47a7-8b8f-82761ec366e5] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:02.005155 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 111/209] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:57:01 2022] GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b => generated 1526 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:57:02.009851 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-6a40c594-a809-4970-8497-871a1b8b6e36 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:02.010466 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-6a40c594-a809-4970-8497-871a1b8b6e36 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] [instance: 3938932a-e778-4c0c-9ab0-78dc9082a48e] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:02.011293 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-335ebd3c-2754-4991-843b-f45fb58f1036 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:02.012042 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-335ebd3c-2754-4991-843b-f45fb58f1036 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:02.013102 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-335ebd3c-2754-4991-843b-f45fb58f1036 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:02.013582 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-335ebd3c-2754-4991-843b-f45fb58f1036 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:02.023497 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-6a40c594-a809-4970-8497-871a1b8b6e36 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:02.024661 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-6a40c594-a809-4970-8497-871a1b8b6e36 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:02.026086 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-6a40c594-a809-4970-8497-871a1b8b6e36 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:02.027136 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-6a40c594-a809-4970-8497-871a1b8b6e36 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:02.246455 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-335ebd3c-2754-4991-843b-f45fb58f1036 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bc14ada1564911b2f0a698aef3f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a4a0cf1852449e8bfc59ddb5a902c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:02.254102 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-6a40c594-a809-4970-8497-871a1b8b6e36 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f41f17f5154e01a699043edc350cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e92110a1545f1b84644b8971bb6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:02.259922 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-335ebd3c-2754-4991-843b-f45fb58f1036 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "GET /compute/v2.1/servers/9a2aa113-3a93-47a7-8b8f-82761ec366e5" status: 200 len: 1370 microversion: 2.1 time: 0.261415 Aug 02 10:57:02.260802 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 99/210] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:57:01 2022] GET /compute/v2.1/servers/9a2aa113-3a93-47a7-8b8f-82761ec366e5 => generated 1370 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:57:02.265387 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-6a40c594-a809-4970-8497-871a1b8b6e36 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] 10.222.0.115 "GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e" status: 200 len: 1725 microversion: 2.1 time: 0.259154 Aug 02 10:57:02.266121 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 112/211] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:57:02 2022] GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e => generated 1725 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:57:02.855895 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-fd9f16fe-bc64-4421-814d-46c1b342cb37 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:02.856544 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-fd9f16fe-bc64-4421-814d-46c1b342cb37 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: b3a92fc5-5c44-48d1-8394-535687bb6ae3] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:02.863883 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-fd9f16fe-bc64-4421-814d-46c1b342cb37 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:02.865356 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-fd9f16fe-bc64-4421-814d-46c1b342cb37 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:02.865356 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-fd9f16fe-bc64-4421-814d-46c1b342cb37 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:02.865625 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-fd9f16fe-bc64-4421-814d-46c1b342cb37 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:02.870147 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG dbcounter [-] [129952] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:57:03.027935 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-8b5de9ae-d21d-4f00-a804-29434e07b97c tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:03.028593 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-8b5de9ae-d21d-4f00-a804-29434e07b97c tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 454053f7-16a6-42c3-9ba0-ca0a40dc5c4b] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:03.037893 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-8b5de9ae-d21d-4f00-a804-29434e07b97c tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:03.038639 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-8b5de9ae-d21d-4f00-a804-29434e07b97c tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:03.039678 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-8b5de9ae-d21d-4f00-a804-29434e07b97c tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:03.040870 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-8b5de9ae-d21d-4f00-a804-29434e07b97c tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:03.056508 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-fd9f16fe-bc64-4421-814d-46c1b342cb37 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:03.069418 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-fd9f16fe-bc64-4421-814d-46c1b342cb37 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:03.072410 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-fd9f16fe-bc64-4421-814d-46c1b342cb37 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:03.074397 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-fd9f16fe-bc64-4421-814d-46c1b342cb37 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3" status: 200 len: 1749 microversion: 2.20 time: 0.222587 Aug 02 10:57:03.087110 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 100/212] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 10:57:02 2022] GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3 => generated 1749 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:57:03.253274 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-8b5de9ae-d21d-4f00-a804-29434e07b97c tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:03.263210 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-8b5de9ae-d21d-4f00-a804-29434e07b97c tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b" status: 200 len: 1526 microversion: 2.1 time: 0.239029 Aug 02 10:57:03.281131 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 113/213] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:57:03 2022] GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b => generated 1526 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:57:03.290608 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-6ba6bcb3-6958-4734-8d86-036c46ea1cb4 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:03.291437 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-6ba6bcb3-6958-4734-8d86-036c46ea1cb4 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] [instance: 3938932a-e778-4c0c-9ab0-78dc9082a48e] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:03.301209 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-6ba6bcb3-6958-4734-8d86-036c46ea1cb4 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:03.301833 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-6ba6bcb3-6958-4734-8d86-036c46ea1cb4 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:03.302881 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-6ba6bcb3-6958-4734-8d86-036c46ea1cb4 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:03.303524 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-6ba6bcb3-6958-4734-8d86-036c46ea1cb4 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:03.314396 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-4fe2e41e-3d21-40f2-89d1-dee83dde2ad3 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:03.316713 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-4fe2e41e-3d21-40f2-89d1-dee83dde2ad3 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: 9a2aa113-3a93-47a7-8b8f-82761ec366e5] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:03.331112 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-4fe2e41e-3d21-40f2-89d1-dee83dde2ad3 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:03.331814 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-4fe2e41e-3d21-40f2-89d1-dee83dde2ad3 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:03.332834 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-4fe2e41e-3d21-40f2-89d1-dee83dde2ad3 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:03.333514 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-4fe2e41e-3d21-40f2-89d1-dee83dde2ad3 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:03.418669 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG dbcounter [-] [129953] Writing DB stats nova_cell0:SELECT=2 {{(pid=129953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:57:03.473165 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG dbcounter [-] [129953] Writing DB stats nova_cell0:SELECT=10 {{(pid=129953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:57:03.553554 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-6ba6bcb3-6958-4734-8d86-036c46ea1cb4 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f41f17f5154e01a699043edc350cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e92110a1545f1b84644b8971bb6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:03.561617 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-6ba6bcb3-6958-4734-8d86-036c46ea1cb4 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] 10.222.0.115 "GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e" status: 200 len: 1725 microversion: 2.1 time: 0.276284 Aug 02 10:57:03.562219 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 101/214] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:57:03 2022] GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e => generated 1725 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:57:03.566071 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-4fe2e41e-3d21-40f2-89d1-dee83dde2ad3 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bc14ada1564911b2f0a698aef3f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a4a0cf1852449e8bfc59ddb5a902c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:03.575034 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-4fe2e41e-3d21-40f2-89d1-dee83dde2ad3 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "GET /compute/v2.1/servers/9a2aa113-3a93-47a7-8b8f-82761ec366e5" status: 200 len: 1370 microversion: 2.1 time: 0.284307 Aug 02 10:57:03.579101 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 114/215] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:57:03 2022] GET /compute/v2.1/servers/9a2aa113-3a93-47a7-8b8f-82761ec366e5 => generated 1370 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:57:04.100551 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-81e672c1-cf53-4691-8150-57599042ae7d tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:04.107924 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-81e672c1-cf53-4691-8150-57599042ae7d tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: b3a92fc5-5c44-48d1-8394-535687bb6ae3] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:04.109025 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-81e672c1-cf53-4691-8150-57599042ae7d tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:04.109686 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-81e672c1-cf53-4691-8150-57599042ae7d tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:04.110526 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-81e672c1-cf53-4691-8150-57599042ae7d tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:04.111028 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-81e672c1-cf53-4691-8150-57599042ae7d tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:04.292464 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-9d957167-e4c2-4e75-9874-95f2cbf0f3de tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:04.294626 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-9d957167-e4c2-4e75-9874-95f2cbf0f3de tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 454053f7-16a6-42c3-9ba0-ca0a40dc5c4b] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:04.304671 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-81e672c1-cf53-4691-8150-57599042ae7d tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:04.305360 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-9d957167-e4c2-4e75-9874-95f2cbf0f3de tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:04.307007 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-9d957167-e4c2-4e75-9874-95f2cbf0f3de tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:04.307007 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-9d957167-e4c2-4e75-9874-95f2cbf0f3de tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:04.307736 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-9d957167-e4c2-4e75-9874-95f2cbf0f3de tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:04.315215 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-81e672c1-cf53-4691-8150-57599042ae7d tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:04.318517 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-81e672c1-cf53-4691-8150-57599042ae7d tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:04.320140 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-81e672c1-cf53-4691-8150-57599042ae7d tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3" status: 200 len: 1744 microversion: 2.20 time: 0.223674 Aug 02 10:57:04.320964 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 102/216] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 10:57:04 2022] GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3 => generated 1744 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:57:04.538457 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-9d957167-e4c2-4e75-9874-95f2cbf0f3de tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:04.553456 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-9d957167-e4c2-4e75-9874-95f2cbf0f3de tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b" status: 200 len: 1526 microversion: 2.1 time: 0.267165 Aug 02 10:57:04.554042 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 115/217] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:57:04 2022] GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b => generated 1526 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:57:04.587501 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-bd9001c1-9701-4a46-a91d-860f359183db tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:04.589128 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-bd9001c1-9701-4a46-a91d-860f359183db tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] [instance: 3938932a-e778-4c0c-9ab0-78dc9082a48e] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:04.598919 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-98e511c7-abf3-450f-bbc6-fdf2535494b3 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:04.604833 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-bd9001c1-9701-4a46-a91d-860f359183db tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:04.605285 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-bd9001c1-9701-4a46-a91d-860f359183db tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:04.606119 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-bd9001c1-9701-4a46-a91d-860f359183db tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:04.606267 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-98e511c7-abf3-450f-bbc6-fdf2535494b3 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: 9a2aa113-3a93-47a7-8b8f-82761ec366e5] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:04.606547 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-bd9001c1-9701-4a46-a91d-860f359183db tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:04.629720 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-98e511c7-abf3-450f-bbc6-fdf2535494b3 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:04.630634 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-98e511c7-abf3-450f-bbc6-fdf2535494b3 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:04.631115 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-98e511c7-abf3-450f-bbc6-fdf2535494b3 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:04.632177 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-98e511c7-abf3-450f-bbc6-fdf2535494b3 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:04.907405 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG dbcounter [-] [129952] Writing DB stats nova_cell0:SELECT=8 {{(pid=129952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:57:05.051746 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-98e511c7-abf3-450f-bbc6-fdf2535494b3 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bc14ada1564911b2f0a698aef3f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a4a0cf1852449e8bfc59ddb5a902c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:05.069535 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-bd9001c1-9701-4a46-a91d-860f359183db tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f41f17f5154e01a699043edc350cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e92110a1545f1b84644b8971bb6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:05.077980 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-98e511c7-abf3-450f-bbc6-fdf2535494b3 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "GET /compute/v2.1/servers/9a2aa113-3a93-47a7-8b8f-82761ec366e5" status: 200 len: 1370 microversion: 2.1 time: 0.480057 Aug 02 10:57:05.092196 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-bd9001c1-9701-4a46-a91d-860f359183db tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] 10.222.0.115 "GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e" status: 200 len: 1725 microversion: 2.1 time: 0.499257 Aug 02 10:57:05.092509 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 116/218] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:57:04 2022] GET /compute/v2.1/servers/9a2aa113-3a93-47a7-8b8f-82761ec366e5 => generated 1370 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:57:05.092606 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 103/219] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:57:04 2022] GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e => generated 1725 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:57:05.227521 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [req-c6ebe921-3f5e-43ff-9b66-37bccb528aa9 req-094c0a1a-77a5-468d-b37f-1ac46a5e6ce1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3a92fc5-5c44-48d1-8394-535687bb6ae3", "name": "network-vif-plugged", "status": "completed", "tag": "03045dd7-30b5-4c87-bcb8-828046dbcd75"}]} {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:57:05.247237 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [req-c6ebe921-3f5e-43ff-9b66-37bccb528aa9 req-094c0a1a-77a5-468d-b37f-1ac46a5e6ce1 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:05.249818 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [req-c6ebe921-3f5e-43ff-9b66-37bccb528aa9 req-094c0a1a-77a5-468d-b37f-1ac46a5e6ce1 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:05.272954 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.compute.server_external_events [req-c6ebe921-3f5e-43ff-9b66-37bccb528aa9 req-094c0a1a-77a5-468d-b37f-1ac46a5e6ce1 service nova] Creating event network-vif-plugged:03045dd7-30b5-4c87-bcb8-828046dbcd75 for instance b3a92fc5-5c44-48d1-8394-535687bb6ae3 on hv-cinder-85031 Aug 02 10:57:05.281887 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [req-c6ebe921-3f5e-43ff-9b66-37bccb528aa9 req-094c0a1a-77a5-468d-b37f-1ac46a5e6ce1 service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058597 Aug 02 10:57:05.283587 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 117/220] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Aug 2 10:57:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:57:05.351193 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-1026ade5-6afc-4a09-9e50-52415f1bdc82 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:05.352415 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-1026ade5-6afc-4a09-9e50-52415f1bdc82 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: b3a92fc5-5c44-48d1-8394-535687bb6ae3] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:05.360473 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-1026ade5-6afc-4a09-9e50-52415f1bdc82 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:05.360926 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-1026ade5-6afc-4a09-9e50-52415f1bdc82 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:05.361709 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-1026ade5-6afc-4a09-9e50-52415f1bdc82 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:05.362226 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-1026ade5-6afc-4a09-9e50-52415f1bdc82 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:05.583157 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-c7c54936-2654-465c-b224-8ad95f1ef6f0 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:05.591452 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-c7c54936-2654-465c-b224-8ad95f1ef6f0 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 454053f7-16a6-42c3-9ba0-ca0a40dc5c4b] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:05.597149 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-c7c54936-2654-465c-b224-8ad95f1ef6f0 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:05.598545 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-c7c54936-2654-465c-b224-8ad95f1ef6f0 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:05.599999 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-c7c54936-2654-465c-b224-8ad95f1ef6f0 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:05.600684 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-c7c54936-2654-465c-b224-8ad95f1ef6f0 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:05.680409 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-1026ade5-6afc-4a09-9e50-52415f1bdc82 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:05.696925 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-1026ade5-6afc-4a09-9e50-52415f1bdc82 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:05.699450 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-1026ade5-6afc-4a09-9e50-52415f1bdc82 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:05.701808 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-1026ade5-6afc-4a09-9e50-52415f1bdc82 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3" status: 200 len: 1744 microversion: 2.20 time: 0.355939 Aug 02 10:57:05.703852 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 104/221] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 10:57:05 2022] GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3 => generated 1744 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:57:06.103923 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-603c56c0-8a0d-4987-b91c-01c28bb6c31f tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:06.104830 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-603c56c0-8a0d-4987-b91c-01c28bb6c31f tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: 9a2aa113-3a93-47a7-8b8f-82761ec366e5] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:06.124449 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-603c56c0-8a0d-4987-b91c-01c28bb6c31f tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:06.125159 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-603c56c0-8a0d-4987-b91c-01c28bb6c31f tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:06.126995 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-603c56c0-8a0d-4987-b91c-01c28bb6c31f tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:06.129597 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-603c56c0-8a0d-4987-b91c-01c28bb6c31f tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:06.326636 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-c7c54936-2654-465c-b224-8ad95f1ef6f0 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:06.379155 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-c7c54936-2654-465c-b224-8ad95f1ef6f0 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b" status: 200 len: 1526 microversion: 2.1 time: 0.789340 Aug 02 10:57:06.532307 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 118/222] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:57:05 2022] GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b => generated 1526 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:57:06.532307 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-14c24c50-8712-4efa-b02b-907599862a67 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:06.532307 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-14c24c50-8712-4efa-b02b-907599862a67 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] [instance: 3938932a-e778-4c0c-9ab0-78dc9082a48e] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:06.532307 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-14c24c50-8712-4efa-b02b-907599862a67 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:06.533021 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-14c24c50-8712-4efa-b02b-907599862a67 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:06.533021 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-14c24c50-8712-4efa-b02b-907599862a67 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:06.533021 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-14c24c50-8712-4efa-b02b-907599862a67 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:06.637532 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-603c56c0-8a0d-4987-b91c-01c28bb6c31f tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bc14ada1564911b2f0a698aef3f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a4a0cf1852449e8bfc59ddb5a902c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:06.637532 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-603c56c0-8a0d-4987-b91c-01c28bb6c31f tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "GET /compute/v2.1/servers/9a2aa113-3a93-47a7-8b8f-82761ec366e5" status: 200 len: 1370 microversion: 2.1 time: 0.525847 Aug 02 10:57:06.647816 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 105/223] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:57:06 2022] GET /compute/v2.1/servers/9a2aa113-3a93-47a7-8b8f-82761ec366e5 => generated 1370 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:57:06.847151 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-df858124-8a5c-4695-95de-9fd7b8cbd74d tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:06.847151 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-df858124-8a5c-4695-95de-9fd7b8cbd74d tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: b3a92fc5-5c44-48d1-8394-535687bb6ae3] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:06.847151 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-df858124-8a5c-4695-95de-9fd7b8cbd74d tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:06.847151 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-df858124-8a5c-4695-95de-9fd7b8cbd74d tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:06.848209 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-df858124-8a5c-4695-95de-9fd7b8cbd74d tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:06.848209 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-df858124-8a5c-4695-95de-9fd7b8cbd74d tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:07.125916 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-df858124-8a5c-4695-95de-9fd7b8cbd74d tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:07.128318 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-df858124-8a5c-4695-95de-9fd7b8cbd74d tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:07.130704 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-df858124-8a5c-4695-95de-9fd7b8cbd74d tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:07.137810 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-df858124-8a5c-4695-95de-9fd7b8cbd74d tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3" status: 200 len: 1744 microversion: 2.20 time: 0.414941 Aug 02 10:57:07.139523 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 106/224] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 10:57:06 2022] GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3 => generated 1744 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:57:07.228009 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-14c24c50-8712-4efa-b02b-907599862a67 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f41f17f5154e01a699043edc350cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e92110a1545f1b84644b8971bb6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:07.247803 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-14c24c50-8712-4efa-b02b-907599862a67 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] 10.222.0.115 "GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e" status: 200 len: 1725 microversion: 2.1 time: 0.829384 Aug 02 10:57:07.250836 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 119/225] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:57:06 2022] GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e => generated 1725 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:57:07.427965 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-435736dd-8f3a-4e2b-a986-199ad08b8207 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:07.428590 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-435736dd-8f3a-4e2b-a986-199ad08b8207 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 454053f7-16a6-42c3-9ba0-ca0a40dc5c4b] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:07.446713 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-435736dd-8f3a-4e2b-a986-199ad08b8207 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:07.446713 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-435736dd-8f3a-4e2b-a986-199ad08b8207 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:07.446713 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-435736dd-8f3a-4e2b-a986-199ad08b8207 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:07.446713 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-435736dd-8f3a-4e2b-a986-199ad08b8207 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:07.672898 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-de9e387e-bcf0-4bba-a61c-f7ebf7a3cf41 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:07.674734 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-de9e387e-bcf0-4bba-a61c-f7ebf7a3cf41 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: 9a2aa113-3a93-47a7-8b8f-82761ec366e5] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:07.693739 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-de9e387e-bcf0-4bba-a61c-f7ebf7a3cf41 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:07.694605 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-de9e387e-bcf0-4bba-a61c-f7ebf7a3cf41 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:07.706923 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-de9e387e-bcf0-4bba-a61c-f7ebf7a3cf41 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:07.707617 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-de9e387e-bcf0-4bba-a61c-f7ebf7a3cf41 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:07.750127 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-435736dd-8f3a-4e2b-a986-199ad08b8207 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:07.761683 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-435736dd-8f3a-4e2b-a986-199ad08b8207 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b" status: 200 len: 1526 microversion: 2.1 time: 0.346327 Aug 02 10:57:07.763980 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 107/226] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:57:07 2022] GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b => generated 1526 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:57:07.775176 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [req-d4187580-c102-474d-8105-87150efc2b63 req-4b1768d0-a799-44a9-af9e-bd86dbf34596 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a2aa113-3a93-47a7-8b8f-82761ec366e5", "name": "network-vif-plugged", "status": "completed", "tag": "c5e050fb-f15e-4f37-af10-39c26d5ad028"}]} {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:57:07.804534 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [req-d4187580-c102-474d-8105-87150efc2b63 req-4b1768d0-a799-44a9-af9e-bd86dbf34596 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:07.807604 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [req-d4187580-c102-474d-8105-87150efc2b63 req-4b1768d0-a799-44a9-af9e-bd86dbf34596 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:07.849811 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.compute.server_external_events [req-d4187580-c102-474d-8105-87150efc2b63 req-4b1768d0-a799-44a9-af9e-bd86dbf34596 service nova] Creating event network-vif-plugged:c5e050fb-f15e-4f37-af10-39c26d5ad028 for instance 9a2aa113-3a93-47a7-8b8f-82761ec366e5 on hv-cinder-85031 Aug 02 10:57:07.876622 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [req-d4187580-c102-474d-8105-87150efc2b63 req-4b1768d0-a799-44a9-af9e-bd86dbf34596 service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110660 Aug 02 10:57:07.881683 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 108/227] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Aug 2 10:57:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:57:07.979602 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-de9e387e-bcf0-4bba-a61c-f7ebf7a3cf41 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bc14ada1564911b2f0a698aef3f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a4a0cf1852449e8bfc59ddb5a902c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:08.000037 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-de9e387e-bcf0-4bba-a61c-f7ebf7a3cf41 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "GET /compute/v2.1/servers/9a2aa113-3a93-47a7-8b8f-82761ec366e5" status: 200 len: 1370 microversion: 2.1 time: 0.333620 Aug 02 10:57:08.000638 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 120/228] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:57:07 2022] GET /compute/v2.1/servers/9a2aa113-3a93-47a7-8b8f-82761ec366e5 => generated 1370 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:57:08.182594 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-7aa8e9fc-1482-4a22-a634-c3fdbc13836a tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:08.186985 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-7aa8e9fc-1482-4a22-a634-c3fdbc13836a tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: b3a92fc5-5c44-48d1-8394-535687bb6ae3] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:08.220413 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-7aa8e9fc-1482-4a22-a634-c3fdbc13836a tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:08.222966 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-7aa8e9fc-1482-4a22-a634-c3fdbc13836a tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:08.222966 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-7aa8e9fc-1482-4a22-a634-c3fdbc13836a tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:08.223702 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-7aa8e9fc-1482-4a22-a634-c3fdbc13836a tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:08.289793 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-2a66b118-4cef-40bd-af34-876dbebe9cb4 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:08.291225 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-2a66b118-4cef-40bd-af34-876dbebe9cb4 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] [instance: 3938932a-e778-4c0c-9ab0-78dc9082a48e] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:08.302752 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-2a66b118-4cef-40bd-af34-876dbebe9cb4 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:08.306764 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-2a66b118-4cef-40bd-af34-876dbebe9cb4 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:08.311370 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-2a66b118-4cef-40bd-af34-876dbebe9cb4 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:08.311370 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-2a66b118-4cef-40bd-af34-876dbebe9cb4 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:08.697900 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-7aa8e9fc-1482-4a22-a634-c3fdbc13836a tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:08.707193 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-7aa8e9fc-1482-4a22-a634-c3fdbc13836a tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:08.714531 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-2a66b118-4cef-40bd-af34-876dbebe9cb4 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f41f17f5154e01a699043edc350cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e92110a1545f1b84644b8971bb6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:08.720428 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-7aa8e9fc-1482-4a22-a634-c3fdbc13836a tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:08.727198 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-2a66b118-4cef-40bd-af34-876dbebe9cb4 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] 10.222.0.115 "GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e" status: 200 len: 1725 microversion: 2.1 time: 0.442322 Aug 02 10:57:08.727812 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 121/229] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:57:08 2022] GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e => generated 1725 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:57:08.743003 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-7aa8e9fc-1482-4a22-a634-c3fdbc13836a tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3" status: 200 len: 1744 microversion: 2.20 time: 0.574084 Aug 02 10:57:08.744045 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 109/230] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 10:57:08 2022] GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3 => generated 1744 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:57:08.787060 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-9770277a-fee6-4771-b626-1fbf79d1359a tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:08.788395 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-9770277a-fee6-4771-b626-1fbf79d1359a tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 454053f7-16a6-42c3-9ba0-ca0a40dc5c4b] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:08.795430 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-9770277a-fee6-4771-b626-1fbf79d1359a tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:08.796244 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-9770277a-fee6-4771-b626-1fbf79d1359a tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:08.797245 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-9770277a-fee6-4771-b626-1fbf79d1359a tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:08.797831 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-9770277a-fee6-4771-b626-1fbf79d1359a tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:09.020885 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-9770277a-fee6-4771-b626-1fbf79d1359a tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:09.027680 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-7e68257e-bd21-43ea-acab-7bf76147d540 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:09.028447 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-7e68257e-bd21-43ea-acab-7bf76147d540 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: 9a2aa113-3a93-47a7-8b8f-82761ec366e5] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:09.033363 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-9770277a-fee6-4771-b626-1fbf79d1359a tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b" status: 200 len: 1526 microversion: 2.1 time: 0.250425 Aug 02 10:57:09.035882 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-7e68257e-bd21-43ea-acab-7bf76147d540 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:09.040568 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-7e68257e-bd21-43ea-acab-7bf76147d540 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:09.041593 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-7e68257e-bd21-43ea-acab-7bf76147d540 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:09.045004 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-7e68257e-bd21-43ea-acab-7bf76147d540 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:09.048278 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 122/231] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:57:08 2022] GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b => generated 1526 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:57:09.311784 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-7e68257e-bd21-43ea-acab-7bf76147d540 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bc14ada1564911b2f0a698aef3f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a4a0cf1852449e8bfc59ddb5a902c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:09.321875 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-7e68257e-bd21-43ea-acab-7bf76147d540 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "GET /compute/v2.1/servers/9a2aa113-3a93-47a7-8b8f-82761ec366e5" status: 200 len: 1370 microversion: 2.1 time: 0.298314 Aug 02 10:57:09.336247 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 110/232] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:57:09 2022] GET /compute/v2.1/servers/9a2aa113-3a93-47a7-8b8f-82761ec366e5 => generated 1370 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:57:09.762530 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-0550dd0a-9a66-4269-9fc6-b315c556ed08 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:09.763911 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-0550dd0a-9a66-4269-9fc6-b315c556ed08 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] [instance: 3938932a-e778-4c0c-9ab0-78dc9082a48e] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:09.774472 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-b96d6a8a-0747-40c5-a522-05d78d0f1243 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:09.775343 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-b96d6a8a-0747-40c5-a522-05d78d0f1243 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: b3a92fc5-5c44-48d1-8394-535687bb6ae3] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:09.788282 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-0550dd0a-9a66-4269-9fc6-b315c556ed08 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:09.790005 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-0550dd0a-9a66-4269-9fc6-b315c556ed08 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:09.791368 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-0550dd0a-9a66-4269-9fc6-b315c556ed08 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:09.794235 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-0550dd0a-9a66-4269-9fc6-b315c556ed08 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:09.798362 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-b96d6a8a-0747-40c5-a522-05d78d0f1243 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:09.799888 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-b96d6a8a-0747-40c5-a522-05d78d0f1243 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:09.801025 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-b96d6a8a-0747-40c5-a522-05d78d0f1243 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:09.801753 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-b96d6a8a-0747-40c5-a522-05d78d0f1243 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:10.088102 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-0550dd0a-9a66-4269-9fc6-b315c556ed08 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f41f17f5154e01a699043edc350cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e92110a1545f1b84644b8971bb6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:10.114183 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-0550dd0a-9a66-4269-9fc6-b315c556ed08 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] 10.222.0.115 "GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e" status: 200 len: 1725 microversion: 2.1 time: 0.367814 Aug 02 10:57:10.115429 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 123/233] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:57:09 2022] GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e => generated 1725 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:57:10.131889 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-67a3b84e-6670-4394-b08a-e087dda66038 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:10.132895 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-67a3b84e-6670-4394-b08a-e087dda66038 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 454053f7-16a6-42c3-9ba0-ca0a40dc5c4b] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:10.150256 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-67a3b84e-6670-4394-b08a-e087dda66038 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:10.150755 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-67a3b84e-6670-4394-b08a-e087dda66038 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:10.155654 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-67a3b84e-6670-4394-b08a-e087dda66038 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:10.156430 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-67a3b84e-6670-4394-b08a-e087dda66038 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:10.200480 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-b96d6a8a-0747-40c5-a522-05d78d0f1243 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:10.222930 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-b96d6a8a-0747-40c5-a522-05d78d0f1243 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:10.232123 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-b96d6a8a-0747-40c5-a522-05d78d0f1243 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:10.236376 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-b96d6a8a-0747-40c5-a522-05d78d0f1243 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3" status: 200 len: 1744 microversion: 2.20 time: 0.467014 Aug 02 10:57:10.239108 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 111/234] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 10:57:09 2022] GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3 => generated 1744 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:57:10.353395 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-8cfe6c3c-d58e-4a00-b1bc-0c486a1dfea6 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:10.353395 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-8cfe6c3c-d58e-4a00-b1bc-0c486a1dfea6 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: 9a2aa113-3a93-47a7-8b8f-82761ec366e5] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:10.370398 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-8cfe6c3c-d58e-4a00-b1bc-0c486a1dfea6 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:10.382701 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-8cfe6c3c-d58e-4a00-b1bc-0c486a1dfea6 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:10.384142 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-8cfe6c3c-d58e-4a00-b1bc-0c486a1dfea6 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:10.384868 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-8cfe6c3c-d58e-4a00-b1bc-0c486a1dfea6 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:10.438946 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-67a3b84e-6670-4394-b08a-e087dda66038 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:10.478513 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-67a3b84e-6670-4394-b08a-e087dda66038 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b" status: 200 len: 1526 microversion: 2.1 time: 0.340568 Aug 02 10:57:10.501054 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 124/235] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:57:10 2022] GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b => generated 1526 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:57:10.779902 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-8cfe6c3c-d58e-4a00-b1bc-0c486a1dfea6 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bc14ada1564911b2f0a698aef3f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a4a0cf1852449e8bfc59ddb5a902c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:10.802924 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-8cfe6c3c-d58e-4a00-b1bc-0c486a1dfea6 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "GET /compute/v2.1/servers/9a2aa113-3a93-47a7-8b8f-82761ec366e5" status: 200 len: 1560 microversion: 2.1 time: 0.456860 Aug 02 10:57:10.820176 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 112/236] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:57:10 2022] GET /compute/v2.1/servers/9a2aa113-3a93-47a7-8b8f-82761ec366e5 => generated 1560 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:57:10.829472 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-f5e15832-44a6-42cd-a569-7fa639d569a8 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:10.829957 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-f5e15832-44a6-42cd-a569-7fa639d569a8 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: 9a2aa113-3a93-47a7-8b8f-82761ec366e5] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:10.837973 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-f5e15832-44a6-42cd-a569-7fa639d569a8 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:10.838556 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-f5e15832-44a6-42cd-a569-7fa639d569a8 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:10.840634 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-f5e15832-44a6-42cd-a569-7fa639d569a8 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:10.841506 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-f5e15832-44a6-42cd-a569-7fa639d569a8 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:10.846435 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG dbcounter [-] [129953] Writing DB stats nova_cell1:SELECT=100 {{(pid=129953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:57:10.994385 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-f5e15832-44a6-42cd-a569-7fa639d569a8 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "GET /compute/v2.1/servers/9a2aa113-3a93-47a7-8b8f-82761ec366e5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.170129 Aug 02 10:57:11.053562 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 125/237] 10.222.0.115 () {58 vars in 1280 bytes} [Tue Aug 2 10:57:10 2022] GET /compute/v2.1/servers/9a2aa113-3a93-47a7-8b8f-82761ec366e5/os-interface => generated 284 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:57:11.158168 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-6c834117-82fc-45c0-9a44-fcd97449c52d tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:11.158431 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-6c834117-82fc-45c0-9a44-fcd97449c52d tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] [instance: 3938932a-e778-4c0c-9ab0-78dc9082a48e] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:11.165834 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-6c834117-82fc-45c0-9a44-fcd97449c52d tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:11.166567 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-6c834117-82fc-45c0-9a44-fcd97449c52d tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:11.167510 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-6c834117-82fc-45c0-9a44-fcd97449c52d tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:11.168044 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-6c834117-82fc-45c0-9a44-fcd97449c52d tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:11.278919 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-67c48430-d084-4566-b28d-02455c6d2656 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:11.361554 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-67c48430-d084-4566-b28d-02455c6d2656 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: b3a92fc5-5c44-48d1-8394-535687bb6ae3] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:11.361554 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-67c48430-d084-4566-b28d-02455c6d2656 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:11.361554 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-67c48430-d084-4566-b28d-02455c6d2656 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:11.361554 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-67c48430-d084-4566-b28d-02455c6d2656 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:11.361926 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-67c48430-d084-4566-b28d-02455c6d2656 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:11.620283 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-6c834117-82fc-45c0-9a44-fcd97449c52d tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f41f17f5154e01a699043edc350cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e92110a1545f1b84644b8971bb6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:11.630033 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-6c834117-82fc-45c0-9a44-fcd97449c52d tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] 10.222.0.115 "GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e" status: 200 len: 1725 microversion: 2.1 time: 0.491955 Aug 02 10:57:11.630999 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 113/238] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:57:11 2022] GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e => generated 1725 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:57:11.635908 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-9a6f5032-b384-41c7-ae99-fd4f1b44b543 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:11.636645 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-9a6f5032-b384-41c7-ae99-fd4f1b44b543 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 454053f7-16a6-42c3-9ba0-ca0a40dc5c4b] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:11.644099 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-9a6f5032-b384-41c7-ae99-fd4f1b44b543 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:11.652035 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-9a6f5032-b384-41c7-ae99-fd4f1b44b543 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:11.652035 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-9a6f5032-b384-41c7-ae99-fd4f1b44b543 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:11.652035 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-9a6f5032-b384-41c7-ae99-fd4f1b44b543 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:11.721497 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-67c48430-d084-4566-b28d-02455c6d2656 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:11.740429 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-67c48430-d084-4566-b28d-02455c6d2656 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:11.742193 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-67c48430-d084-4566-b28d-02455c6d2656 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:11.743858 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-67c48430-d084-4566-b28d-02455c6d2656 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3" status: 200 len: 1744 microversion: 2.20 time: 0.472153 Aug 02 10:57:11.745039 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 126/239] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 10:57:11 2022] GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3 => generated 1744 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:57:11.971569 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-9a6f5032-b384-41c7-ae99-fd4f1b44b543 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:11.980777 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-9a6f5032-b384-41c7-ae99-fd4f1b44b543 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b" status: 200 len: 1526 microversion: 2.1 time: 0.347989 Aug 02 10:57:12.001221 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 114/240] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:57:11 2022] GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b => generated 1526 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:57:12.666764 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-73a99c28-6e8f-416c-9948-799d9216f527 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:12.668070 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-73a99c28-6e8f-416c-9948-799d9216f527 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] [instance: 3938932a-e778-4c0c-9ab0-78dc9082a48e] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:12.684074 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-73a99c28-6e8f-416c-9948-799d9216f527 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:12.684596 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-73a99c28-6e8f-416c-9948-799d9216f527 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:12.685434 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-73a99c28-6e8f-416c-9948-799d9216f527 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:12.685877 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-73a99c28-6e8f-416c-9948-799d9216f527 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:12.783356 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-d2d5de2f-ee21-444b-8830-c6c1c3ee1bbe tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:12.784644 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-d2d5de2f-ee21-444b-8830-c6c1c3ee1bbe tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: b3a92fc5-5c44-48d1-8394-535687bb6ae3] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:12.804861 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-d2d5de2f-ee21-444b-8830-c6c1c3ee1bbe tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:12.805599 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-d2d5de2f-ee21-444b-8830-c6c1c3ee1bbe tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:12.806557 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-d2d5de2f-ee21-444b-8830-c6c1c3ee1bbe tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:12.809673 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-d2d5de2f-ee21-444b-8830-c6c1c3ee1bbe tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:13.055107 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-73a99c28-6e8f-416c-9948-799d9216f527 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f41f17f5154e01a699043edc350cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e92110a1545f1b84644b8971bb6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:13.072320 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-73a99c28-6e8f-416c-9948-799d9216f527 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] 10.222.0.115 "GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e" status: 200 len: 1725 microversion: 2.1 time: 0.417693 Aug 02 10:57:13.078423 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 127/241] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:57:12 2022] GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e => generated 1725 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:57:13.104592 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-9add094f-c022-44b1-a957-66ffe23e7586 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:13.105893 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-9add094f-c022-44b1-a957-66ffe23e7586 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 454053f7-16a6-42c3-9ba0-ca0a40dc5c4b] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:13.114888 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-9add094f-c022-44b1-a957-66ffe23e7586 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:13.115350 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-9add094f-c022-44b1-a957-66ffe23e7586 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:13.116178 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-9add094f-c022-44b1-a957-66ffe23e7586 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:13.116749 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-9add094f-c022-44b1-a957-66ffe23e7586 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:13.199221 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-d2d5de2f-ee21-444b-8830-c6c1c3ee1bbe tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:13.218420 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-d2d5de2f-ee21-444b-8830-c6c1c3ee1bbe tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:13.223240 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-d2d5de2f-ee21-444b-8830-c6c1c3ee1bbe tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:13.227891 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-d2d5de2f-ee21-444b-8830-c6c1c3ee1bbe tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3" status: 200 len: 1744 microversion: 2.20 time: 0.456289 Aug 02 10:57:13.230747 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 115/242] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 10:57:12 2022] GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3 => generated 1744 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:57:13.244957 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [req-10368895-9467-4104-a931-8ec96502f469 req-2df8a215-4be9-4c02-a6e7-43516d9e9e01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a2aa113-3a93-47a7-8b8f-82761ec366e5", "tag": "c5e050fb-f15e-4f37-af10-39c26d5ad028"}]} {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:57:13.271117 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [req-10368895-9467-4104-a931-8ec96502f469 req-2df8a215-4be9-4c02-a6e7-43516d9e9e01 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:13.277553 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [req-10368895-9467-4104-a931-8ec96502f469 req-2df8a215-4be9-4c02-a6e7-43516d9e9e01 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:13.311770 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.compute.server_external_events [req-10368895-9467-4104-a931-8ec96502f469 req-2df8a215-4be9-4c02-a6e7-43516d9e9e01 service nova] Creating event network-changed:c5e050fb-f15e-4f37-af10-39c26d5ad028 for instance 9a2aa113-3a93-47a7-8b8f-82761ec366e5 on hv-cinder-85031 Aug 02 10:57:13.322185 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [req-10368895-9467-4104-a931-8ec96502f469 req-2df8a215-4be9-4c02-a6e7-43516d9e9e01 service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089809 Aug 02 10:57:13.325362 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 116/243] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Aug 2 10:57:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:57:13.418791 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-9add094f-c022-44b1-a957-66ffe23e7586 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:13.429060 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-9add094f-c022-44b1-a957-66ffe23e7586 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b" status: 200 len: 1526 microversion: 2.1 time: 0.349513 Aug 02 10:57:13.429802 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 128/244] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:57:13 2022] GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b => generated 1526 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:57:14.102169 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-ae6ebdd0-f5bc-459f-86e3-68f2d8c73044 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:14.103530 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-ae6ebdd0-f5bc-459f-86e3-68f2d8c73044 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] [instance: 3938932a-e778-4c0c-9ab0-78dc9082a48e] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:14.110858 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-ae6ebdd0-f5bc-459f-86e3-68f2d8c73044 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:14.111583 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-ae6ebdd0-f5bc-459f-86e3-68f2d8c73044 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:14.112587 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-ae6ebdd0-f5bc-459f-86e3-68f2d8c73044 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:14.113193 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-ae6ebdd0-f5bc-459f-86e3-68f2d8c73044 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:14.258334 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-3f3d4c7f-c813-43e0-a96b-0699b8bb9ed7 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:14.259700 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-3f3d4c7f-c813-43e0-a96b-0699b8bb9ed7 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: b3a92fc5-5c44-48d1-8394-535687bb6ae3] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:14.275332 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-3f3d4c7f-c813-43e0-a96b-0699b8bb9ed7 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:14.296333 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-3f3d4c7f-c813-43e0-a96b-0699b8bb9ed7 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:14.300231 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-3f3d4c7f-c813-43e0-a96b-0699b8bb9ed7 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:14.305879 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-3f3d4c7f-c813-43e0-a96b-0699b8bb9ed7 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:14.332099 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-ae6ebdd0-f5bc-459f-86e3-68f2d8c73044 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f41f17f5154e01a699043edc350cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e92110a1545f1b84644b8971bb6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:14.346230 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-ae6ebdd0-f5bc-459f-86e3-68f2d8c73044 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] 10.222.0.115 "GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e" status: 200 len: 1725 microversion: 2.1 time: 0.248687 Aug 02 10:57:14.351396 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 117/245] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:57:14 2022] GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e => generated 1725 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:57:14.457069 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-aaa1434b-5ea5-490d-80ab-dd17c41c213f tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:14.458532 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-aaa1434b-5ea5-490d-80ab-dd17c41c213f tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 454053f7-16a6-42c3-9ba0-ca0a40dc5c4b] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:14.468182 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-aaa1434b-5ea5-490d-80ab-dd17c41c213f tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:14.469263 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-aaa1434b-5ea5-490d-80ab-dd17c41c213f tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:14.470564 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-aaa1434b-5ea5-490d-80ab-dd17c41c213f tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:14.471279 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-aaa1434b-5ea5-490d-80ab-dd17c41c213f tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:14.485170 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG dbcounter [-] [129952] Writing DB stats nova_cell1:SELECT=100 {{(pid=129952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:57:14.766983 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-aaa1434b-5ea5-490d-80ab-dd17c41c213f tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:14.775664 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-aaa1434b-5ea5-490d-80ab-dd17c41c213f tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b" status: 200 len: 1526 microversion: 2.1 time: 0.324766 Aug 02 10:57:14.794230 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 118/246] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:57:14 2022] GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b => generated 1526 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:57:14.809841 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-3f3d4c7f-c813-43e0-a96b-0699b8bb9ed7 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:14.825607 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-3f3d4c7f-c813-43e0-a96b-0699b8bb9ed7 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:14.827181 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-3f3d4c7f-c813-43e0-a96b-0699b8bb9ed7 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:14.828390 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-3f3d4c7f-c813-43e0-a96b-0699b8bb9ed7 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3" status: 200 len: 1744 microversion: 2.20 time: 0.575709 Aug 02 10:57:14.831585 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 129/247] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 10:57:14 2022] GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3 => generated 1744 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:57:15.371650 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-9eb40e3a-cce8-4996-83f5-2e29bf9a7f7f tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:15.372411 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-9eb40e3a-cce8-4996-83f5-2e29bf9a7f7f tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] [instance: 3938932a-e778-4c0c-9ab0-78dc9082a48e] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:15.380317 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-9eb40e3a-cce8-4996-83f5-2e29bf9a7f7f tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:15.384175 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-9eb40e3a-cce8-4996-83f5-2e29bf9a7f7f tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:15.393105 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-9eb40e3a-cce8-4996-83f5-2e29bf9a7f7f tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:15.393705 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-9eb40e3a-cce8-4996-83f5-2e29bf9a7f7f tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:15.597892 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-9eb40e3a-cce8-4996-83f5-2e29bf9a7f7f tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f41f17f5154e01a699043edc350cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e92110a1545f1b84644b8971bb6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:15.610842 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-9eb40e3a-cce8-4996-83f5-2e29bf9a7f7f tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] 10.222.0.115 "GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e" status: 200 len: 1725 microversion: 2.1 time: 0.243174 Aug 02 10:57:15.610842 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 119/248] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:57:15 2022] GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e => generated 1725 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:57:15.798737 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-cc1c14e4-25ab-4d31-85fd-95642aef4fe0 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:15.800036 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-cc1c14e4-25ab-4d31-85fd-95642aef4fe0 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 454053f7-16a6-42c3-9ba0-ca0a40dc5c4b] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:15.817014 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-cc1c14e4-25ab-4d31-85fd-95642aef4fe0 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:15.819097 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-cc1c14e4-25ab-4d31-85fd-95642aef4fe0 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:15.820479 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-cc1c14e4-25ab-4d31-85fd-95642aef4fe0 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:15.821336 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-cc1c14e4-25ab-4d31-85fd-95642aef4fe0 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:15.852462 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-f997120a-ce07-4644-8136-2f2daeb62822 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:15.853509 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-f997120a-ce07-4644-8136-2f2daeb62822 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: b3a92fc5-5c44-48d1-8394-535687bb6ae3] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:15.863840 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-f997120a-ce07-4644-8136-2f2daeb62822 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:15.867489 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-f997120a-ce07-4644-8136-2f2daeb62822 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:15.868573 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-f997120a-ce07-4644-8136-2f2daeb62822 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:15.869179 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-f997120a-ce07-4644-8136-2f2daeb62822 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:16.104158 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-cc1c14e4-25ab-4d31-85fd-95642aef4fe0 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:16.117596 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-cc1c14e4-25ab-4d31-85fd-95642aef4fe0 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b" status: 200 len: 1526 microversion: 2.1 time: 0.323410 Aug 02 10:57:16.122120 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 130/249] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:57:15 2022] GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b => generated 1526 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:57:16.220910 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-f997120a-ce07-4644-8136-2f2daeb62822 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:16.245877 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-f997120a-ce07-4644-8136-2f2daeb62822 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:16.253710 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-f997120a-ce07-4644-8136-2f2daeb62822 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:16.255016 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-f997120a-ce07-4644-8136-2f2daeb62822 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3" status: 200 len: 1744 microversion: 2.20 time: 0.406453 Aug 02 10:57:16.262628 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 120/250] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 10:57:15 2022] GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3 => generated 1744 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:57:16.635827 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-4d5d995a-c0ba-4180-be08-65bf61eff21c tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:16.637304 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-4d5d995a-c0ba-4180-be08-65bf61eff21c tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] [instance: 3938932a-e778-4c0c-9ab0-78dc9082a48e] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:16.646138 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-4d5d995a-c0ba-4180-be08-65bf61eff21c tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:16.646581 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-4d5d995a-c0ba-4180-be08-65bf61eff21c tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:16.647638 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-4d5d995a-c0ba-4180-be08-65bf61eff21c tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:16.648220 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-4d5d995a-c0ba-4180-be08-65bf61eff21c tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:17.039865 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-4d5d995a-c0ba-4180-be08-65bf61eff21c tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f41f17f5154e01a699043edc350cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e92110a1545f1b84644b8971bb6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:17.062599 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-4d5d995a-c0ba-4180-be08-65bf61eff21c tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] 10.222.0.115 "GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e" status: 200 len: 1725 microversion: 2.1 time: 0.430566 Aug 02 10:57:17.063268 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 131/251] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:57:16 2022] GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e => generated 1725 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:57:17.143075 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-cb9241c1-eb9a-4ef4-94ec-96d58cd68795 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:17.144188 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-cb9241c1-eb9a-4ef4-94ec-96d58cd68795 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 454053f7-16a6-42c3-9ba0-ca0a40dc5c4b] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:17.152641 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-cb9241c1-eb9a-4ef4-94ec-96d58cd68795 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:17.153184 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-cb9241c1-eb9a-4ef4-94ec-96d58cd68795 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:17.154398 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-cb9241c1-eb9a-4ef4-94ec-96d58cd68795 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:17.155170 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-cb9241c1-eb9a-4ef4-94ec-96d58cd68795 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:17.284282 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-d1875c16-dbba-4312-bf3f-e1adde036931 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:17.288466 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-d1875c16-dbba-4312-bf3f-e1adde036931 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: b3a92fc5-5c44-48d1-8394-535687bb6ae3] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:17.294964 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-d1875c16-dbba-4312-bf3f-e1adde036931 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:17.295939 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-d1875c16-dbba-4312-bf3f-e1adde036931 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:17.297522 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-d1875c16-dbba-4312-bf3f-e1adde036931 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:17.298408 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-d1875c16-dbba-4312-bf3f-e1adde036931 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:17.342630 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-cb9241c1-eb9a-4ef4-94ec-96d58cd68795 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:17.350393 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-cb9241c1-eb9a-4ef4-94ec-96d58cd68795 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b" status: 200 len: 1526 microversion: 2.1 time: 0.214251 Aug 02 10:57:17.350969 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 121/252] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:57:17 2022] GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b => generated 1526 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:57:17.482305 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-d1875c16-dbba-4312-bf3f-e1adde036931 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:17.494674 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-d1875c16-dbba-4312-bf3f-e1adde036931 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:17.497631 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-d1875c16-dbba-4312-bf3f-e1adde036931 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:17.499008 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-d1875c16-dbba-4312-bf3f-e1adde036931 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3" status: 200 len: 1744 microversion: 2.20 time: 0.218738 Aug 02 10:57:17.517718 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 132/253] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 10:57:17 2022] GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3 => generated 1744 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:57:18.086376 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-5973b787-3fd4-42d1-ab25-ce281eb9488a tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:18.087165 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-5973b787-3fd4-42d1-ab25-ce281eb9488a tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] [instance: 3938932a-e778-4c0c-9ab0-78dc9082a48e] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:18.098946 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-5973b787-3fd4-42d1-ab25-ce281eb9488a tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:18.104051 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-5973b787-3fd4-42d1-ab25-ce281eb9488a tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:18.108112 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-5973b787-3fd4-42d1-ab25-ce281eb9488a tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:18.109452 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-5973b787-3fd4-42d1-ab25-ce281eb9488a tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:18.376143 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-8344d5b6-1ca4-4c9f-92f5-327dde8c35d8 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:18.376796 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-8344d5b6-1ca4-4c9f-92f5-327dde8c35d8 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 454053f7-16a6-42c3-9ba0-ca0a40dc5c4b] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:18.397657 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-8344d5b6-1ca4-4c9f-92f5-327dde8c35d8 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:18.398122 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-8344d5b6-1ca4-4c9f-92f5-327dde8c35d8 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:18.405537 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-5973b787-3fd4-42d1-ab25-ce281eb9488a tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f41f17f5154e01a699043edc350cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e92110a1545f1b84644b8971bb6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:18.413530 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-8344d5b6-1ca4-4c9f-92f5-327dde8c35d8 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:18.416727 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-8344d5b6-1ca4-4c9f-92f5-327dde8c35d8 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:18.420469 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-5973b787-3fd4-42d1-ab25-ce281eb9488a tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] 10.222.0.115 "GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e" status: 200 len: 1725 microversion: 2.1 time: 0.338458 Aug 02 10:57:18.440657 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 122/254] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:57:18 2022] GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e => generated 1725 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:57:18.545607 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-1fcf1864-914a-4b6e-83b0-f59ba1cde1f2 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:18.546303 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-1fcf1864-914a-4b6e-83b0-f59ba1cde1f2 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: b3a92fc5-5c44-48d1-8394-535687bb6ae3] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:18.556439 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-1fcf1864-914a-4b6e-83b0-f59ba1cde1f2 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:18.556888 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-1fcf1864-914a-4b6e-83b0-f59ba1cde1f2 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:18.558995 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-1fcf1864-914a-4b6e-83b0-f59ba1cde1f2 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:18.559472 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-1fcf1864-914a-4b6e-83b0-f59ba1cde1f2 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:18.813624 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-8344d5b6-1ca4-4c9f-92f5-327dde8c35d8 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:18.831343 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-8344d5b6-1ca4-4c9f-92f5-327dde8c35d8 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b" status: 200 len: 1526 microversion: 2.1 time: 0.461067 Aug 02 10:57:18.834205 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 133/255] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:57:18 2022] GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b => generated 1526 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:57:18.883795 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-1fcf1864-914a-4b6e-83b0-f59ba1cde1f2 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:18.894965 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-1fcf1864-914a-4b6e-83b0-f59ba1cde1f2 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:18.903031 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-1fcf1864-914a-4b6e-83b0-f59ba1cde1f2 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:18.912033 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-1fcf1864-914a-4b6e-83b0-f59ba1cde1f2 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3" status: 200 len: 1744 microversion: 2.20 time: 0.371943 Aug 02 10:57:18.918005 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 123/256] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 10:57:18 2022] GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3 => generated 1744 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:57:19.456308 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-cbfa56a8-fb8c-42fa-99d7-73a00b4488fd tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:19.462616 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-cbfa56a8-fb8c-42fa-99d7-73a00b4488fd tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] [instance: 3938932a-e778-4c0c-9ab0-78dc9082a48e] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:19.481083 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-cbfa56a8-fb8c-42fa-99d7-73a00b4488fd tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:19.484101 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-cbfa56a8-fb8c-42fa-99d7-73a00b4488fd tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:19.487334 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-cbfa56a8-fb8c-42fa-99d7-73a00b4488fd tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:19.489277 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-cbfa56a8-fb8c-42fa-99d7-73a00b4488fd tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:19.813592 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-cbfa56a8-fb8c-42fa-99d7-73a00b4488fd tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f41f17f5154e01a699043edc350cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e92110a1545f1b84644b8971bb6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:19.826525 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-cbfa56a8-fb8c-42fa-99d7-73a00b4488fd tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] 10.222.0.115 "GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e" status: 200 len: 1725 microversion: 2.1 time: 0.376737 Aug 02 10:57:19.840164 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 134/257] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:57:19 2022] GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e => generated 1725 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:57:19.856104 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-f6dccebc-ff2c-4757-940b-366f1a97eb28 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:19.857616 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-f6dccebc-ff2c-4757-940b-366f1a97eb28 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 454053f7-16a6-42c3-9ba0-ca0a40dc5c4b] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:19.865243 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-f6dccebc-ff2c-4757-940b-366f1a97eb28 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:19.866181 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-f6dccebc-ff2c-4757-940b-366f1a97eb28 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:19.867379 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-f6dccebc-ff2c-4757-940b-366f1a97eb28 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:19.868040 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-f6dccebc-ff2c-4757-940b-366f1a97eb28 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:19.937859 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-b8714fe7-aba8-456a-bb73-21353ccc0313 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:19.938459 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-b8714fe7-aba8-456a-bb73-21353ccc0313 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: b3a92fc5-5c44-48d1-8394-535687bb6ae3] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:19.961521 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-b8714fe7-aba8-456a-bb73-21353ccc0313 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:19.961886 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-b8714fe7-aba8-456a-bb73-21353ccc0313 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:19.962667 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-b8714fe7-aba8-456a-bb73-21353ccc0313 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:19.970347 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-b8714fe7-aba8-456a-bb73-21353ccc0313 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:20.119173 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-f6dccebc-ff2c-4757-940b-366f1a97eb28 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:20.129350 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-f6dccebc-ff2c-4757-940b-366f1a97eb28 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b" status: 200 len: 1526 microversion: 2.1 time: 0.278058 Aug 02 10:57:20.145148 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 124/258] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:57:19 2022] GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b => generated 1526 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:57:20.474292 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-b8714fe7-aba8-456a-bb73-21353ccc0313 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:20.486381 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-b8714fe7-aba8-456a-bb73-21353ccc0313 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:20.488484 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-b8714fe7-aba8-456a-bb73-21353ccc0313 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:20.490027 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-b8714fe7-aba8-456a-bb73-21353ccc0313 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3" status: 200 len: 1744 microversion: 2.20 time: 0.556262 Aug 02 10:57:20.491084 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 135/259] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 10:57:19 2022] GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3 => generated 1744 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:57:20.856199 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-3d2e6c36-ec26-4d19-a7a8-0397315f5bd9 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:20.858072 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-3d2e6c36-ec26-4d19-a7a8-0397315f5bd9 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] [instance: 3938932a-e778-4c0c-9ab0-78dc9082a48e] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:20.869356 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-3d2e6c36-ec26-4d19-a7a8-0397315f5bd9 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:20.873051 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-3d2e6c36-ec26-4d19-a7a8-0397315f5bd9 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:20.874137 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-3d2e6c36-ec26-4d19-a7a8-0397315f5bd9 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:20.874827 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-3d2e6c36-ec26-4d19-a7a8-0397315f5bd9 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:21.155786 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-020e6bef-ee2a-4462-82b5-bdec2fd56364 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:21.157305 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-020e6bef-ee2a-4462-82b5-bdec2fd56364 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 454053f7-16a6-42c3-9ba0-ca0a40dc5c4b] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:21.176866 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-3d2e6c36-ec26-4d19-a7a8-0397315f5bd9 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f41f17f5154e01a699043edc350cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e92110a1545f1b84644b8971bb6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:21.177339 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-020e6bef-ee2a-4462-82b5-bdec2fd56364 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:21.178242 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-020e6bef-ee2a-4462-82b5-bdec2fd56364 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:21.179479 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-020e6bef-ee2a-4462-82b5-bdec2fd56364 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:21.181739 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-020e6bef-ee2a-4462-82b5-bdec2fd56364 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:21.194782 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-3d2e6c36-ec26-4d19-a7a8-0397315f5bd9 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] 10.222.0.115 "GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e" status: 200 len: 1725 microversion: 2.1 time: 0.343999 Aug 02 10:57:21.196436 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 125/260] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:57:20 2022] GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e => generated 1725 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:57:21.372792 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-020e6bef-ee2a-4462-82b5-bdec2fd56364 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:21.382559 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-020e6bef-ee2a-4462-82b5-bdec2fd56364 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b" status: 200 len: 1526 microversion: 2.1 time: 0.234247 Aug 02 10:57:21.398132 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 136/261] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:57:21 2022] GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b => generated 1526 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:57:21.518928 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-ee47e73e-3de1-45e7-b13c-794b3e8676de tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:21.519570 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-ee47e73e-3de1-45e7-b13c-794b3e8676de tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: b3a92fc5-5c44-48d1-8394-535687bb6ae3] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:21.546155 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-ee47e73e-3de1-45e7-b13c-794b3e8676de tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:21.550166 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-ee47e73e-3de1-45e7-b13c-794b3e8676de tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:21.556479 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-ee47e73e-3de1-45e7-b13c-794b3e8676de tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:21.560968 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-ee47e73e-3de1-45e7-b13c-794b3e8676de tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:21.804801 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-ee47e73e-3de1-45e7-b13c-794b3e8676de tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:21.826999 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-4e6d9187-d6ce-4654-90ec-3f05836ceb5b tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Action: 'create', calling method: .version_select at 0x7f7c4ef00ca0>, body: {"keypair": {"name": "tempest-TestShelveInstance-2083744582", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHffz815rBIg5++BkOi6pXjE7mo37TzSCKaRN7+kmZl0r/RzDmm23qZlGUV5ho1mh+IjEJJUpH5aRyh2LrNHBxTRoF9Z2q7YJuFoKwnlR4eJM8l1dk8SMWERVHnKXU5n4w=="}} {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:57:21.835944 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-ee47e73e-3de1-45e7-b13c-794b3e8676de tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:21.837956 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-ee47e73e-3de1-45e7-b13c-794b3e8676de tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:21.843536 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-ee47e73e-3de1-45e7-b13c-794b3e8676de tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3" status: 200 len: 1744 microversion: 2.20 time: 0.329902 Aug 02 10:57:21.858131 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 137/262] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 10:57:21 2022] GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3 => generated 1744 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:57:21.858131 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-840d2047-4c19-4513-aaaa-d6aa9f1651cc tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1496085593", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1578588330", "security_groups": [{"name": "tempest-secgroup-smoke-1142860438"}], "block_device_mapping_v2": [{"uuid": "2fe55858-da4e-4587-8a7c-0a4b7855da50", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "45890e76-360d-451b-af94-f2be74c19cda"}]}} {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:57:21.881509 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.quota [None req-4e6d9187-d6ce-4654-90ec-3f05836ceb5b tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Getting quotas for project cd54719e5f2b41e6a875361a9188d49b. Resources: {'key_pairs'} {{(pid=129952) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 10:57:21.890550 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.quota [None req-4e6d9187-d6ce-4654-90ec-3f05836ceb5b tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Getting quotas for user 2664b70cbc1a41a59f78b0b7d4e86643 and project cd54719e5f2b41e6a875361a9188d49b. Resources: {'key_pairs'} {{(pid=129952) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 10:57:22.052136 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-4e6d9187-d6ce-4654-90ec-3f05836ceb5b tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] 10.222.0.115 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.547841 Aug 02 10:57:22.053369 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 126/263] 10.222.0.115 () {60 vars in 1164 bytes} [Tue Aug 2 10:57:21 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:57:22.112429 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.network.neutron [None req-840d2047-4c19-4513-aaaa-d6aa9f1651cc tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] validate_networks() for [('45890e76-360d-451b-af94-f2be74c19cda', None, None, None, None, None)] {{(pid=129953) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 10:57:22.217445 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-17492e92-8bf8-4455-ae7f-e6fb5f0b08bd tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:22.218424 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-17492e92-8bf8-4455-ae7f-e6fb5f0b08bd tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] [instance: 3938932a-e778-4c0c-9ab0-78dc9082a48e] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:22.232511 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-17492e92-8bf8-4455-ae7f-e6fb5f0b08bd tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:22.236591 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-17492e92-8bf8-4455-ae7f-e6fb5f0b08bd tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:22.239277 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-17492e92-8bf8-4455-ae7f-e6fb5f0b08bd tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:22.241733 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-17492e92-8bf8-4455-ae7f-e6fb5f0b08bd tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:22.445843 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG dbcounter [-] [129953] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=129953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:57:22.692738 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-17492e92-8bf8-4455-ae7f-e6fb5f0b08bd tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f41f17f5154e01a699043edc350cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e92110a1545f1b84644b8971bb6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:22.708610 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-17492e92-8bf8-4455-ae7f-e6fb5f0b08bd tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] 10.222.0.115 "GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e" status: 200 len: 1725 microversion: 2.1 time: 0.495671 Aug 02 10:57:22.709937 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 127/264] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:57:22 2022] GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e => generated 1725 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:57:22.716463 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-3b9515b3-a9f3-4eab-a56a-9ac754a6175a tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:22.717509 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-3b9515b3-a9f3-4eab-a56a-9ac754a6175a tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 454053f7-16a6-42c3-9ba0-ca0a40dc5c4b] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:22.734311 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-3b9515b3-a9f3-4eab-a56a-9ac754a6175a tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:22.734311 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-3b9515b3-a9f3-4eab-a56a-9ac754a6175a tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:22.734794 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-3b9515b3-a9f3-4eab-a56a-9ac754a6175a tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:22.736312 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-3b9515b3-a9f3-4eab-a56a-9ac754a6175a tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:23.022841 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.virt.hardware [None req-840d2047-4c19-4513-aaaa-d6aa9f1651cc tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Flavor limits 0:0:0 {{(pid=129953) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 10:57:23.024220 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.virt.hardware [None req-840d2047-4c19-4513-aaaa-d6aa9f1651cc tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Image limits 0:0:0 {{(pid=129953) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 10:57:23.024908 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.virt.hardware [None req-840d2047-4c19-4513-aaaa-d6aa9f1651cc tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Flavor pref 0:0:0 {{(pid=129953) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 10:57:23.025517 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.virt.hardware [None req-840d2047-4c19-4513-aaaa-d6aa9f1651cc tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Image pref 0:0:0 {{(pid=129953) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 10:57:23.025973 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.virt.hardware [None req-840d2047-4c19-4513-aaaa-d6aa9f1651cc tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129953) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 10:57:23.048265 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-840d2047-4c19-4513-aaaa-d6aa9f1651cc tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:23.049593 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-840d2047-4c19-4513-aaaa-d6aa9f1651cc tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:23.050675 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-840d2047-4c19-4513-aaaa-d6aa9f1651cc tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:23.052997 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-840d2047-4c19-4513-aaaa-d6aa9f1651cc tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:23.062528 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-3b9515b3-a9f3-4eab-a56a-9ac754a6175a tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:23.070810 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-3b9515b3-a9f3-4eab-a56a-9ac754a6175a tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b" status: 200 len: 1526 microversion: 2.1 time: 0.359664 Aug 02 10:57:23.071788 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 128/265] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:57:22 2022] GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b => generated 1526 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:57:23.079523 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-d52a9428-bade-4b67-94bd-d1e96e60016e tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:23.079523 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-d52a9428-bade-4b67-94bd-d1e96e60016e tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: b3a92fc5-5c44-48d1-8394-535687bb6ae3] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:23.086789 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-d52a9428-bade-4b67-94bd-d1e96e60016e tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:23.087958 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-d52a9428-bade-4b67-94bd-d1e96e60016e tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:23.089959 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-d52a9428-bade-4b67-94bd-d1e96e60016e tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:23.090420 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-d52a9428-bade-4b67-94bd-d1e96e60016e tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:23.094914 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.quota [None req-840d2047-4c19-4513-aaaa-d6aa9f1651cc tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Getting quotas for project be66234794284419a47e3afcae968084. Resources: {'instances', 'cores', 'ram'} {{(pid=129953) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 10:57:23.100219 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.quota [None req-840d2047-4c19-4513-aaaa-d6aa9f1651cc tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Getting quotas for user 914de37664914b4cb91e0ce2c3a0e1d1 and project be66234794284419a47e3afcae968084. Resources: {'instances', 'cores', 'ram'} {{(pid=129953) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 10:57:23.206005 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-840d2047-4c19-4513-aaaa-d6aa9f1651cc tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Going to run 1 instances... {{(pid=129953) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 10:57:23.208208 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-840d2047-4c19-4513-aaaa-d6aa9f1651cc tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] [instance: eb175839-504d-4d07-b576-d51202b9ccae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2fe55858-da4e-4587-8a7c-0a4b7855da50',volume_size=None,volume_type=None)] {{(pid=129953) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 10:57:23.312557 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-d52a9428-bade-4b67-94bd-d1e96e60016e tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:23.326982 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-d52a9428-bade-4b67-94bd-d1e96e60016e tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:23.328806 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-d52a9428-bade-4b67-94bd-d1e96e60016e tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:23.329824 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-d52a9428-bade-4b67-94bd-d1e96e60016e tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3" status: 200 len: 1744 microversion: 2.20 time: 0.256738 Aug 02 10:57:23.330389 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 129/266] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 10:57:23 2022] GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3 => generated 1744 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:57:23.734467 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-aba7c827-35c8-4421-9049-08e085d1f8ca tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:23.735212 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-aba7c827-35c8-4421-9049-08e085d1f8ca tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] [instance: 3938932a-e778-4c0c-9ab0-78dc9082a48e] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:23.745393 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-aba7c827-35c8-4421-9049-08e085d1f8ca tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:23.746994 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-aba7c827-35c8-4421-9049-08e085d1f8ca tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:23.746994 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-aba7c827-35c8-4421-9049-08e085d1f8ca tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:23.747490 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-aba7c827-35c8-4421-9049-08e085d1f8ca tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:23.916258 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-aba7c827-35c8-4421-9049-08e085d1f8ca tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f41f17f5154e01a699043edc350cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e92110a1545f1b84644b8971bb6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:23.926367 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-aba7c827-35c8-4421-9049-08e085d1f8ca tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] 10.222.0.115 "GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e" status: 200 len: 1725 microversion: 2.1 time: 0.196233 Aug 02 10:57:23.926957 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 130/267] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:57:23 2022] GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e => generated 1725 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:57:24.093563 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-3b06ca6e-44e5-47ff-95de-7ed4df930fba tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:24.094282 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-3b06ca6e-44e5-47ff-95de-7ed4df930fba tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 454053f7-16a6-42c3-9ba0-ca0a40dc5c4b] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:24.100664 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-3b06ca6e-44e5-47ff-95de-7ed4df930fba tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:24.101120 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-3b06ca6e-44e5-47ff-95de-7ed4df930fba tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:24.101922 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-3b06ca6e-44e5-47ff-95de-7ed4df930fba tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:24.102796 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-3b06ca6e-44e5-47ff-95de-7ed4df930fba tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:24.217110 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-840d2047-4c19-4513-aaaa-d6aa9f1651cc tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] 10.222.0.115 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 2.370630 Aug 02 10:57:24.218454 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 138/268] 10.222.0.115 () {60 vars in 1152 bytes} [Tue Aug 2 10:57:21 2022] POST /compute/v2.1/servers => generated 408 bytes in 2373 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 02 10:57:24.230975 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-753fc2b2-ac9e-4b3b-a417-c370f639b896 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:24.230975 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-753fc2b2-ac9e-4b3b-a417-c370f639b896 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] [instance: eb175839-504d-4d07-b576-d51202b9ccae] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:24.298519 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-753fc2b2-ac9e-4b3b-a417-c370f639b896 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914de37664914b4cb91e0ce2c3a0e1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66234794284419a47e3afcae968084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:24.318983 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-753fc2b2-ac9e-4b3b-a417-c370f639b896 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] 10.222.0.115 "GET /compute/v2.1/servers/eb175839-504d-4d07-b576-d51202b9ccae" status: 200 len: 1098 microversion: 2.1 time: 0.093367 Aug 02 10:57:24.319912 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 139/269] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:57:24 2022] GET /compute/v2.1/servers/eb175839-504d-4d07-b576-d51202b9ccae => generated 1098 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:57:24.348359 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-3b06ca6e-44e5-47ff-95de-7ed4df930fba tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:24.356574 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-5e999c67-7844-4147-958a-2ad9b7d778a1 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:24.357114 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-5e999c67-7844-4147-958a-2ad9b7d778a1 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: b3a92fc5-5c44-48d1-8394-535687bb6ae3] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:24.358617 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-3b06ca6e-44e5-47ff-95de-7ed4df930fba tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b" status: 200 len: 1526 microversion: 2.1 time: 0.269503 Aug 02 10:57:24.359231 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 131/270] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:57:24 2022] GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b => generated 1526 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:57:24.381530 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-5e999c67-7844-4147-958a-2ad9b7d778a1 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:24.381987 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-5e999c67-7844-4147-958a-2ad9b7d778a1 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:24.382754 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-5e999c67-7844-4147-958a-2ad9b7d778a1 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:24.383221 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-5e999c67-7844-4147-958a-2ad9b7d778a1 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:24.642010 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-5e999c67-7844-4147-958a-2ad9b7d778a1 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:24.648913 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-5e999c67-7844-4147-958a-2ad9b7d778a1 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:24.650627 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-5e999c67-7844-4147-958a-2ad9b7d778a1 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:24.651878 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-5e999c67-7844-4147-958a-2ad9b7d778a1 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3" status: 200 len: 1744 microversion: 2.20 time: 0.300113 Aug 02 10:57:24.652452 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 140/271] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 10:57:24 2022] GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3 => generated 1744 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:57:24.952027 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-a01ac487-a32f-4239-9ed5-4a514aaabfe7 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:24.952745 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-a01ac487-a32f-4239-9ed5-4a514aaabfe7 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] [instance: 3938932a-e778-4c0c-9ab0-78dc9082a48e] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:24.963790 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-a01ac487-a32f-4239-9ed5-4a514aaabfe7 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:24.971201 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-a01ac487-a32f-4239-9ed5-4a514aaabfe7 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:24.972803 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-a01ac487-a32f-4239-9ed5-4a514aaabfe7 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:24.973218 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-a01ac487-a32f-4239-9ed5-4a514aaabfe7 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:25.215904 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-a01ac487-a32f-4239-9ed5-4a514aaabfe7 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f41f17f5154e01a699043edc350cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e92110a1545f1b84644b8971bb6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:25.225697 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-a01ac487-a32f-4239-9ed5-4a514aaabfe7 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] 10.222.0.115 "GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e" status: 200 len: 1725 microversion: 2.1 time: 0.278014 Aug 02 10:57:25.226292 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 132/272] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:57:24 2022] GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e => generated 1725 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:57:25.342837 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-76597dd1-2d97-4ef1-b6a4-4a6d380e6673 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:25.344141 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-76597dd1-2d97-4ef1-b6a4-4a6d380e6673 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] [instance: eb175839-504d-4d07-b576-d51202b9ccae] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:25.385015 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-10c8b359-bfc5-4b8f-b286-59c957fc083a tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:25.386028 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-10c8b359-bfc5-4b8f-b286-59c957fc083a tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 454053f7-16a6-42c3-9ba0-ca0a40dc5c4b] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:25.400503 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-10c8b359-bfc5-4b8f-b286-59c957fc083a tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:25.400966 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-10c8b359-bfc5-4b8f-b286-59c957fc083a tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:25.423370 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-10c8b359-bfc5-4b8f-b286-59c957fc083a tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:25.423370 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-10c8b359-bfc5-4b8f-b286-59c957fc083a tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:25.445822 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-76597dd1-2d97-4ef1-b6a4-4a6d380e6673 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914de37664914b4cb91e0ce2c3a0e1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66234794284419a47e3afcae968084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:25.456677 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-76597dd1-2d97-4ef1-b6a4-4a6d380e6673 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] 10.222.0.115 "GET /compute/v2.1/servers/eb175839-504d-4d07-b576-d51202b9ccae" status: 200 len: 1098 microversion: 2.1 time: 0.118290 Aug 02 10:57:25.459731 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 141/273] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:57:25 2022] GET /compute/v2.1/servers/eb175839-504d-4d07-b576-d51202b9ccae => generated 1098 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:57:25.602684 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-10c8b359-bfc5-4b8f-b286-59c957fc083a tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:25.615240 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-10c8b359-bfc5-4b8f-b286-59c957fc083a tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b" status: 200 len: 1526 microversion: 2.1 time: 0.234498 Aug 02 10:57:25.630335 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 133/274] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:57:25 2022] GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b => generated 1526 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:57:25.680488 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-75fb767f-851c-4a9f-bf19-c51a999e57e5 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:25.681435 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-75fb767f-851c-4a9f-bf19-c51a999e57e5 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: b3a92fc5-5c44-48d1-8394-535687bb6ae3] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:25.695333 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-75fb767f-851c-4a9f-bf19-c51a999e57e5 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:25.696789 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-75fb767f-851c-4a9f-bf19-c51a999e57e5 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:25.698662 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-75fb767f-851c-4a9f-bf19-c51a999e57e5 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:25.699153 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-75fb767f-851c-4a9f-bf19-c51a999e57e5 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:25.847622 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-75fb767f-851c-4a9f-bf19-c51a999e57e5 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:25.861505 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-75fb767f-851c-4a9f-bf19-c51a999e57e5 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:25.865221 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-75fb767f-851c-4a9f-bf19-c51a999e57e5 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:25.866486 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-75fb767f-851c-4a9f-bf19-c51a999e57e5 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3" status: 200 len: 1744 microversion: 2.20 time: 0.190660 Aug 02 10:57:25.867082 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 142/275] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 10:57:25 2022] GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3 => generated 1744 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:57:26.249089 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-f8c4f38c-d4c7-4322-9fd9-0a871100df1d tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:26.249731 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-f8c4f38c-d4c7-4322-9fd9-0a871100df1d tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] [instance: 3938932a-e778-4c0c-9ab0-78dc9082a48e] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:26.256796 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-f8c4f38c-d4c7-4322-9fd9-0a871100df1d tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:26.257252 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-f8c4f38c-d4c7-4322-9fd9-0a871100df1d tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:26.258031 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-f8c4f38c-d4c7-4322-9fd9-0a871100df1d tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:26.258478 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-f8c4f38c-d4c7-4322-9fd9-0a871100df1d tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:26.426499 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-f8c4f38c-d4c7-4322-9fd9-0a871100df1d tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f41f17f5154e01a699043edc350cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e92110a1545f1b84644b8971bb6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:26.450114 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-f8c4f38c-d4c7-4322-9fd9-0a871100df1d tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] 10.222.0.115 "GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e" status: 200 len: 1725 microversion: 2.1 time: 0.205600 Aug 02 10:57:26.456356 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 134/276] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:57:26 2022] GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e => generated 1725 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:57:26.482913 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-2d034ae2-1138-49ee-9cce-cc26e4694389 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:26.485007 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-2d034ae2-1138-49ee-9cce-cc26e4694389 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] [instance: eb175839-504d-4d07-b576-d51202b9ccae] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:26.500940 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-2d034ae2-1138-49ee-9cce-cc26e4694389 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:26.500940 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-2d034ae2-1138-49ee-9cce-cc26e4694389 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:26.500940 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-2d034ae2-1138-49ee-9cce-cc26e4694389 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:26.500940 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-2d034ae2-1138-49ee-9cce-cc26e4694389 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:26.574700 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-2d034ae2-1138-49ee-9cce-cc26e4694389 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914de37664914b4cb91e0ce2c3a0e1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66234794284419a47e3afcae968084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:26.593044 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-2d034ae2-1138-49ee-9cce-cc26e4694389 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] 10.222.0.115 "GET /compute/v2.1/servers/eb175839-504d-4d07-b576-d51202b9ccae" status: 200 len: 1148 microversion: 2.1 time: 0.115597 Aug 02 10:57:26.602998 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 143/277] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:57:26 2022] GET /compute/v2.1/servers/eb175839-504d-4d07-b576-d51202b9ccae => generated 1148 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:57:26.646905 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-88e0b7c3-150f-4bec-a93c-2c4073d351e4 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:26.646905 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-88e0b7c3-150f-4bec-a93c-2c4073d351e4 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 454053f7-16a6-42c3-9ba0-ca0a40dc5c4b] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:26.647267 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG dbcounter [-] [129952] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=1 {{(pid=129952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:57:26.669434 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-88e0b7c3-150f-4bec-a93c-2c4073d351e4 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:26.670952 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-88e0b7c3-150f-4bec-a93c-2c4073d351e4 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:26.673033 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-88e0b7c3-150f-4bec-a93c-2c4073d351e4 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:26.676596 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-88e0b7c3-150f-4bec-a93c-2c4073d351e4 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:26.893212 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-bdf62f4e-9429-4efa-9725-847a819582af tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:26.895023 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-bdf62f4e-9429-4efa-9725-847a819582af tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: b3a92fc5-5c44-48d1-8394-535687bb6ae3] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:26.915236 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-bdf62f4e-9429-4efa-9725-847a819582af tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:26.918107 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-bdf62f4e-9429-4efa-9725-847a819582af tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:26.918966 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-bdf62f4e-9429-4efa-9725-847a819582af tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:26.919445 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-bdf62f4e-9429-4efa-9725-847a819582af tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:26.976976 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-88e0b7c3-150f-4bec-a93c-2c4073d351e4 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:26.982025 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG dbcounter [-] [129952] Writing DB stats nova_cell1:SELECT=100 {{(pid=129952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:57:26.991863 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-88e0b7c3-150f-4bec-a93c-2c4073d351e4 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b" status: 200 len: 1526 microversion: 2.1 time: 0.353414 Aug 02 10:57:26.998667 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 135/278] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:57:26 2022] GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b => generated 1526 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:57:27.186647 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-bdf62f4e-9429-4efa-9725-847a819582af tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:27.190304 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG dbcounter [-] [129953] Writing DB stats nova_cell1:SELECT=100 {{(pid=129953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:57:27.198977 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-bdf62f4e-9429-4efa-9725-847a819582af tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:27.200911 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-bdf62f4e-9429-4efa-9725-847a819582af tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:27.202712 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-bdf62f4e-9429-4efa-9725-847a819582af tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3" status: 200 len: 1726 microversion: 2.20 time: 0.313905 Aug 02 10:57:27.215077 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 144/279] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 10:57:26 2022] GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3 => generated 1726 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:57:27.480550 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-49fa9739-289d-40c0-bca3-7fcf96298081 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:27.481270 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-49fa9739-289d-40c0-bca3-7fcf96298081 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] [instance: 3938932a-e778-4c0c-9ab0-78dc9082a48e] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:27.488742 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-49fa9739-289d-40c0-bca3-7fcf96298081 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:27.489189 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-49fa9739-289d-40c0-bca3-7fcf96298081 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:27.491206 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-49fa9739-289d-40c0-bca3-7fcf96298081 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:27.491841 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-49fa9739-289d-40c0-bca3-7fcf96298081 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:27.620309 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-58e31f30-dce0-4826-8068-6ed06e5ad74f tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:27.622206 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-58e31f30-dce0-4826-8068-6ed06e5ad74f tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] [instance: eb175839-504d-4d07-b576-d51202b9ccae] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:27.642138 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-58e31f30-dce0-4826-8068-6ed06e5ad74f tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:27.643117 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-58e31f30-dce0-4826-8068-6ed06e5ad74f tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:27.646308 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-58e31f30-dce0-4826-8068-6ed06e5ad74f tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:27.646971 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-58e31f30-dce0-4826-8068-6ed06e5ad74f tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:27.671690 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-49fa9739-289d-40c0-bca3-7fcf96298081 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f41f17f5154e01a699043edc350cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e92110a1545f1b84644b8971bb6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:27.680791 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-49fa9739-289d-40c0-bca3-7fcf96298081 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] 10.222.0.115 "GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e" status: 200 len: 1725 microversion: 2.1 time: 0.205339 Aug 02 10:57:27.692962 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 136/280] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:57:27 2022] GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e => generated 1725 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:57:27.727485 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-58e31f30-dce0-4826-8068-6ed06e5ad74f tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914de37664914b4cb91e0ce2c3a0e1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66234794284419a47e3afcae968084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:27.738280 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-58e31f30-dce0-4826-8068-6ed06e5ad74f tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] 10.222.0.115 "GET /compute/v2.1/servers/eb175839-504d-4d07-b576-d51202b9ccae" status: 200 len: 1196 microversion: 2.1 time: 0.123378 Aug 02 10:57:27.739450 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 145/281] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:57:27 2022] GET /compute/v2.1/servers/eb175839-504d-4d07-b576-d51202b9ccae => generated 1196 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:57:28.025163 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-c2fe2764-f19d-41c5-9cf8-62a98e79c6d6 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:28.026236 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-c2fe2764-f19d-41c5-9cf8-62a98e79c6d6 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 454053f7-16a6-42c3-9ba0-ca0a40dc5c4b] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:28.033982 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-c2fe2764-f19d-41c5-9cf8-62a98e79c6d6 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:28.034676 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-c2fe2764-f19d-41c5-9cf8-62a98e79c6d6 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:28.035743 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-c2fe2764-f19d-41c5-9cf8-62a98e79c6d6 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:28.036252 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-c2fe2764-f19d-41c5-9cf8-62a98e79c6d6 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:28.203897 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-c2fe2764-f19d-41c5-9cf8-62a98e79c6d6 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:28.212323 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-c2fe2764-f19d-41c5-9cf8-62a98e79c6d6 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b" status: 200 len: 1526 microversion: 2.1 time: 0.191357 Aug 02 10:57:28.212905 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 137/282] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:57:28 2022] GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b => generated 1526 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:57:28.230028 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-b505d326-3bcd-4408-a65d-f1dbffb6b95f tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:28.231028 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-b505d326-3bcd-4408-a65d-f1dbffb6b95f tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: b3a92fc5-5c44-48d1-8394-535687bb6ae3] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:28.238998 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-b505d326-3bcd-4408-a65d-f1dbffb6b95f tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:28.239477 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-b505d326-3bcd-4408-a65d-f1dbffb6b95f tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:28.240267 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-b505d326-3bcd-4408-a65d-f1dbffb6b95f tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:28.240701 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-b505d326-3bcd-4408-a65d-f1dbffb6b95f tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:28.396804 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-b505d326-3bcd-4408-a65d-f1dbffb6b95f tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:28.406131 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-b505d326-3bcd-4408-a65d-f1dbffb6b95f tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:28.407666 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-b505d326-3bcd-4408-a65d-f1dbffb6b95f tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:28.411259 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-b505d326-3bcd-4408-a65d-f1dbffb6b95f tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3" status: 200 len: 1726 microversion: 2.20 time: 0.183799 Aug 02 10:57:28.411259 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 146/283] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 10:57:28 2022] GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3 => generated 1726 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:57:28.705837 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-57a2364a-4c52-493e-bae3-ba817eb6dcb9 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:28.706475 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-57a2364a-4c52-493e-bae3-ba817eb6dcb9 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] [instance: 3938932a-e778-4c0c-9ab0-78dc9082a48e] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:28.713066 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-57a2364a-4c52-493e-bae3-ba817eb6dcb9 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:28.717757 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-57a2364a-4c52-493e-bae3-ba817eb6dcb9 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:28.717757 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-57a2364a-4c52-493e-bae3-ba817eb6dcb9 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:28.717757 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-57a2364a-4c52-493e-bae3-ba817eb6dcb9 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:28.762624 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-f253174b-6e84-400d-98db-ad0bb8538ba7 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:28.763279 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-f253174b-6e84-400d-98db-ad0bb8538ba7 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] [instance: eb175839-504d-4d07-b576-d51202b9ccae] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:28.769327 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-f253174b-6e84-400d-98db-ad0bb8538ba7 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:28.769763 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-f253174b-6e84-400d-98db-ad0bb8538ba7 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:28.770525 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-f253174b-6e84-400d-98db-ad0bb8538ba7 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:28.770950 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-f253174b-6e84-400d-98db-ad0bb8538ba7 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:28.844923 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-f253174b-6e84-400d-98db-ad0bb8538ba7 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914de37664914b4cb91e0ce2c3a0e1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66234794284419a47e3afcae968084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:28.854287 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-f253174b-6e84-400d-98db-ad0bb8538ba7 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] 10.222.0.115 "GET /compute/v2.1/servers/eb175839-504d-4d07-b576-d51202b9ccae" status: 200 len: 1204 microversion: 2.1 time: 0.097105 Aug 02 10:57:28.859920 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 147/284] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:57:28 2022] GET /compute/v2.1/servers/eb175839-504d-4d07-b576-d51202b9ccae => generated 1204 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:57:28.906382 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-57a2364a-4c52-493e-bae3-ba817eb6dcb9 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f41f17f5154e01a699043edc350cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e92110a1545f1b84644b8971bb6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:28.915203 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-57a2364a-4c52-493e-bae3-ba817eb6dcb9 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] 10.222.0.115 "GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e" status: 200 len: 1725 microversion: 2.1 time: 0.213243 Aug 02 10:57:28.915835 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 138/285] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:57:28 2022] GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e => generated 1725 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:57:29.237572 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-182ab9f4-8682-4990-b821-e23a7929bb04 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:29.237572 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-182ab9f4-8682-4990-b821-e23a7929bb04 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 454053f7-16a6-42c3-9ba0-ca0a40dc5c4b] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:29.241814 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-182ab9f4-8682-4990-b821-e23a7929bb04 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:29.242339 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-182ab9f4-8682-4990-b821-e23a7929bb04 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:29.243231 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-182ab9f4-8682-4990-b821-e23a7929bb04 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:29.243742 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-182ab9f4-8682-4990-b821-e23a7929bb04 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:29.381861 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-182ab9f4-8682-4990-b821-e23a7929bb04 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:29.389967 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-182ab9f4-8682-4990-b821-e23a7929bb04 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b" status: 200 len: 1526 microversion: 2.1 time: 0.159958 Aug 02 10:57:29.390538 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 148/286] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:57:29 2022] GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b => generated 1526 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:57:29.434778 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-3ddea4be-5f73-44e5-a2c7-cb7879f8f9d9 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:29.435655 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-3ddea4be-5f73-44e5-a2c7-cb7879f8f9d9 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: b3a92fc5-5c44-48d1-8394-535687bb6ae3] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:29.442178 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-3ddea4be-5f73-44e5-a2c7-cb7879f8f9d9 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:29.442624 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-3ddea4be-5f73-44e5-a2c7-cb7879f8f9d9 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:29.443440 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-3ddea4be-5f73-44e5-a2c7-cb7879f8f9d9 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:29.443877 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-3ddea4be-5f73-44e5-a2c7-cb7879f8f9d9 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:29.582211 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-3ddea4be-5f73-44e5-a2c7-cb7879f8f9d9 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:29.592139 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-3ddea4be-5f73-44e5-a2c7-cb7879f8f9d9 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:29.593489 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-3ddea4be-5f73-44e5-a2c7-cb7879f8f9d9 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:29.594708 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-3ddea4be-5f73-44e5-a2c7-cb7879f8f9d9 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3" status: 200 len: 1726 microversion: 2.20 time: 0.165875 Aug 02 10:57:29.595357 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 139/287] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 10:57:29 2022] GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3 => generated 1726 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:57:29.878079 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-dd68c8b6-5bac-4abb-95bb-d694cef1a346 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:29.878953 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-dd68c8b6-5bac-4abb-95bb-d694cef1a346 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] [instance: eb175839-504d-4d07-b576-d51202b9ccae] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:29.888958 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-dd68c8b6-5bac-4abb-95bb-d694cef1a346 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:29.889412 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-dd68c8b6-5bac-4abb-95bb-d694cef1a346 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:29.890195 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-dd68c8b6-5bac-4abb-95bb-d694cef1a346 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:29.890623 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-dd68c8b6-5bac-4abb-95bb-d694cef1a346 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:29.939675 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-48bedfe2-2a34-424e-8657-2c527dc27b31 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:29.940415 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-48bedfe2-2a34-424e-8657-2c527dc27b31 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] [instance: 3938932a-e778-4c0c-9ab0-78dc9082a48e] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:29.951747 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-48bedfe2-2a34-424e-8657-2c527dc27b31 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:29.952569 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-48bedfe2-2a34-424e-8657-2c527dc27b31 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:29.953598 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-48bedfe2-2a34-424e-8657-2c527dc27b31 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:29.954251 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-48bedfe2-2a34-424e-8657-2c527dc27b31 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:29.974548 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-dd68c8b6-5bac-4abb-95bb-d694cef1a346 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914de37664914b4cb91e0ce2c3a0e1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66234794284419a47e3afcae968084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:29.983427 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-dd68c8b6-5bac-4abb-95bb-d694cef1a346 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] 10.222.0.115 "GET /compute/v2.1/servers/eb175839-504d-4d07-b576-d51202b9ccae" status: 200 len: 1204 microversion: 2.1 time: 0.110397 Aug 02 10:57:29.984059 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 149/288] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:57:29 2022] GET /compute/v2.1/servers/eb175839-504d-4d07-b576-d51202b9ccae => generated 1204 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:57:30.154704 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-48bedfe2-2a34-424e-8657-2c527dc27b31 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f41f17f5154e01a699043edc350cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e92110a1545f1b84644b8971bb6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:30.164774 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-48bedfe2-2a34-424e-8657-2c527dc27b31 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] 10.222.0.115 "GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e" status: 200 len: 1725 microversion: 2.1 time: 0.229221 Aug 02 10:57:30.165370 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 140/289] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:57:29 2022] GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e => generated 1725 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:57:30.410634 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-b8b7ea70-077e-46af-9e44-480af5cdb11b tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:30.411210 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-b8b7ea70-077e-46af-9e44-480af5cdb11b tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 454053f7-16a6-42c3-9ba0-ca0a40dc5c4b] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:30.423076 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-b8b7ea70-077e-46af-9e44-480af5cdb11b tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:30.423608 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-b8b7ea70-077e-46af-9e44-480af5cdb11b tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:30.424398 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-b8b7ea70-077e-46af-9e44-480af5cdb11b tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:30.424867 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-b8b7ea70-077e-46af-9e44-480af5cdb11b tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:30.618439 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-bd9a37e4-c21f-4d9a-9f1d-afbe66ecc794 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:30.619086 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-bd9a37e4-c21f-4d9a-9f1d-afbe66ecc794 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: b3a92fc5-5c44-48d1-8394-535687bb6ae3] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:30.625676 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-bd9a37e4-c21f-4d9a-9f1d-afbe66ecc794 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:30.626559 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-bd9a37e4-c21f-4d9a-9f1d-afbe66ecc794 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:30.627364 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-bd9a37e4-c21f-4d9a-9f1d-afbe66ecc794 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:30.627798 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-bd9a37e4-c21f-4d9a-9f1d-afbe66ecc794 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:30.645270 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-b8b7ea70-077e-46af-9e44-480af5cdb11b tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:30.660221 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-b8b7ea70-077e-46af-9e44-480af5cdb11b tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b" status: 200 len: 1526 microversion: 2.1 time: 0.253907 Aug 02 10:57:30.660876 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 150/290] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:57:30 2022] GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b => generated 1526 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:57:30.826510 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-bd9a37e4-c21f-4d9a-9f1d-afbe66ecc794 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:30.837984 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-bd9a37e4-c21f-4d9a-9f1d-afbe66ecc794 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:30.840441 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-bd9a37e4-c21f-4d9a-9f1d-afbe66ecc794 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:30.841695 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-bd9a37e4-c21f-4d9a-9f1d-afbe66ecc794 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3" status: 200 len: 1729 microversion: 2.20 time: 0.227587 Aug 02 10:57:30.843060 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 141/291] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 10:57:30 2022] GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3 => generated 1729 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:57:30.864589 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-cd24582d-74e8-48b3-b53e-4bd581bedbe0 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1dee1c87-78cf-4483-9c38-fa40c80c9238"}} {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:57:30.867144 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-cd24582d-74e8-48b3-b53e-4bd581bedbe0 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: b3a92fc5-5c44-48d1-8394-535687bb6ae3] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:30.878059 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-cd24582d-74e8-48b3-b53e-4bd581bedbe0 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:30.878878 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-cd24582d-74e8-48b3-b53e-4bd581bedbe0 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:30.879613 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-cd24582d-74e8-48b3-b53e-4bd581bedbe0 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:30.881131 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-cd24582d-74e8-48b3-b53e-4bd581bedbe0 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:31.016017 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-901fd6eb-c996-4d48-9fd2-73dedee13293 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:31.025058 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-901fd6eb-c996-4d48-9fd2-73dedee13293 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] [instance: eb175839-504d-4d07-b576-d51202b9ccae] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:31.040908 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-901fd6eb-c996-4d48-9fd2-73dedee13293 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:31.041290 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-901fd6eb-c996-4d48-9fd2-73dedee13293 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:31.042610 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-901fd6eb-c996-4d48-9fd2-73dedee13293 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:31.043113 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-901fd6eb-c996-4d48-9fd2-73dedee13293 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:31.309455 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-901fd6eb-c996-4d48-9fd2-73dedee13293 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914de37664914b4cb91e0ce2c3a0e1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66234794284419a47e3afcae968084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:31.317700 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-901fd6eb-c996-4d48-9fd2-73dedee13293 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] 10.222.0.115 "GET /compute/v2.1/servers/eb175839-504d-4d07-b576-d51202b9ccae" status: 200 len: 1282 microversion: 2.1 time: 0.315259 Aug 02 10:57:31.318418 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 142/292] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:57:31 2022] GET /compute/v2.1/servers/eb175839-504d-4d07-b576-d51202b9ccae => generated 1282 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:57:31.339002 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [req-26a8d174-bbf1-41c2-92a4-f52591189172 req-d9b47853-055c-494e-94be-289c5c116cb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3a92fc5-5c44-48d1-8394-535687bb6ae3", "name": "network-vif-unplugged", "status": "completed", "tag": "03045dd7-30b5-4c87-bcb8-828046dbcd75"}]} {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:57:31.348942 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [req-26a8d174-bbf1-41c2-92a4-f52591189172 req-d9b47853-055c-494e-94be-289c5c116cb7 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:31.349661 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [req-26a8d174-bbf1-41c2-92a4-f52591189172 req-d9b47853-055c-494e-94be-289c5c116cb7 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:31.361969 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.compute.server_external_events [req-26a8d174-bbf1-41c2-92a4-f52591189172 req-d9b47853-055c-494e-94be-289c5c116cb7 service nova] Unable to find a host for instance b3a92fc5-5c44-48d1-8394-535687bb6ae3. Dropping event network-vif-unplugged {{(pid=129952) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 02 10:57:31.363027 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [req-26a8d174-bbf1-41c2-92a4-f52591189172 req-d9b47853-055c-494e-94be-289c5c116cb7 service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028445 Aug 02 10:57:31.363848 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 143/293] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Aug 2 10:57:31 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 45 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 02 10:57:31.368774 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-f59138a9-a669-410c-bb7a-a49202871074 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:31.369392 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-f59138a9-a669-410c-bb7a-a49202871074 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] [instance: 3938932a-e778-4c0c-9ab0-78dc9082a48e] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:31.376735 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-f59138a9-a669-410c-bb7a-a49202871074 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:31.377189 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-f59138a9-a669-410c-bb7a-a49202871074 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:31.377966 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-f59138a9-a669-410c-bb7a-a49202871074 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:31.378404 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-f59138a9-a669-410c-bb7a-a49202871074 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:31.618002 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-f59138a9-a669-410c-bb7a-a49202871074 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f41f17f5154e01a699043edc350cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e92110a1545f1b84644b8971bb6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:31.626549 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-f59138a9-a669-410c-bb7a-a49202871074 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] 10.222.0.115 "GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e" status: 200 len: 1702 microversion: 2.1 time: 0.261631 Aug 02 10:57:31.627142 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 144/294] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:57:31 2022] GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e => generated 1702 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:57:31.657169 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-d53892be-8913-4c68-87ff-287a8dbf9692 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:57:31.664159 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-d53892be-8913-4c68-87ff-287a8dbf9692 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:31.665081 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-d53892be-8913-4c68-87ff-287a8dbf9692 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:31.712110 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-d53892be-8913-4c68-87ff-287a8dbf9692 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] [instance: 3938932a-e778-4c0c-9ab0-78dc9082a48e] Going to try to start instance {{(pid=129952) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 02 10:57:31.915707 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG dbcounter [-] [129952] Writing DB stats nova_cell0:SELECT=4 {{(pid=129952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:57:31.978703 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-d53892be-8913-4c68-87ff-287a8dbf9692 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] 10.222.0.115 "POST /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e/action" status: 202 len: 0 microversion: 2.1 time: 0.325417 Aug 02 10:57:31.979705 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 145/295] 10.222.0.115 () {60 vars in 1283 bytes} [Tue Aug 2 10:57:31 2022] POST /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e/action => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 10:57:31.985125 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-15c8cf24-0980-4d8b-883f-0ffda34cec7e tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:31.985828 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-15c8cf24-0980-4d8b-883f-0ffda34cec7e tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 454053f7-16a6-42c3-9ba0-ca0a40dc5c4b] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:31.992406 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-15c8cf24-0980-4d8b-883f-0ffda34cec7e tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:31.992852 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-15c8cf24-0980-4d8b-883f-0ffda34cec7e tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:31.993679 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-15c8cf24-0980-4d8b-883f-0ffda34cec7e tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:31.994118 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-15c8cf24-0980-4d8b-883f-0ffda34cec7e tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:32.192641 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-cd24582d-74e8-48b3-b53e-4bd581bedbe0 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "POST /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.331982 Aug 02 10:57:32.193511 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 151/296] 10.222.0.115 () {62 vars in 1369 bytes} [Tue Aug 2 10:57:30 2022] POST /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3/os-volume_attachments => generated 188 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:57:32.203715 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-10210ef7-744e-473d-9322-52da8cd932be tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:32.204499 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-10210ef7-744e-473d-9322-52da8cd932be tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] [instance: 3938932a-e778-4c0c-9ab0-78dc9082a48e] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:32.216142 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-10210ef7-744e-473d-9322-52da8cd932be tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:32.216607 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-10210ef7-744e-473d-9322-52da8cd932be tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:32.217384 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-10210ef7-744e-473d-9322-52da8cd932be tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:32.217823 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-10210ef7-744e-473d-9322-52da8cd932be tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:32.245299 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-15c8cf24-0980-4d8b-883f-0ffda34cec7e tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:32.262786 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-15c8cf24-0980-4d8b-883f-0ffda34cec7e tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b" status: 200 len: 1526 microversion: 2.1 time: 0.281761 Aug 02 10:57:32.267097 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 146/297] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:57:31 2022] GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b => generated 1526 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:57:32.343494 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-08dc282e-c524-42df-8fc1-dcc7cd4cfdd4 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:32.344692 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-08dc282e-c524-42df-8fc1-dcc7cd4cfdd4 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] [instance: eb175839-504d-4d07-b576-d51202b9ccae] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:32.364174 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-08dc282e-c524-42df-8fc1-dcc7cd4cfdd4 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:32.364990 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-08dc282e-c524-42df-8fc1-dcc7cd4cfdd4 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:32.365971 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-08dc282e-c524-42df-8fc1-dcc7cd4cfdd4 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:32.366590 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-08dc282e-c524-42df-8fc1-dcc7cd4cfdd4 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:32.505647 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-10210ef7-744e-473d-9322-52da8cd932be tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f41f17f5154e01a699043edc350cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e92110a1545f1b84644b8971bb6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:32.526727 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-10210ef7-744e-473d-9322-52da8cd932be tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] 10.222.0.115 "GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e" status: 200 len: 1711 microversion: 2.1 time: 0.331210 Aug 02 10:57:32.527173 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 152/298] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:57:32 2022] GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e => generated 1711 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:57:32.533477 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-2c73b38d-0773-4384-9428-d7c0399a08c0 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:57:32.533705 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-2c73b38d-0773-4384-9428-d7c0399a08c0 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: b3a92fc5-5c44-48d1-8394-535687bb6ae3] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:32.540831 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-2c73b38d-0773-4384-9428-d7c0399a08c0 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:32.542336 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-2c73b38d-0773-4384-9428-d7c0399a08c0 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:32.543409 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-2c73b38d-0773-4384-9428-d7c0399a08c0 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:32.544006 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-2c73b38d-0773-4384-9428-d7c0399a08c0 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:32.558358 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-08dc282e-c524-42df-8fc1-dcc7cd4cfdd4 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914de37664914b4cb91e0ce2c3a0e1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66234794284419a47e3afcae968084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:32.566692 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-08dc282e-c524-42df-8fc1-dcc7cd4cfdd4 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] 10.222.0.115 "GET /compute/v2.1/servers/eb175839-504d-4d07-b576-d51202b9ccae" status: 200 len: 1270 microversion: 2.1 time: 0.227186 Aug 02 10:57:32.567579 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 147/299] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:57:32 2022] GET /compute/v2.1/servers/eb175839-504d-4d07-b576-d51202b9ccae => generated 1270 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:57:32.599074 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-2c73b38d-0773-4384-9428-d7c0399a08c0 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: b3a92fc5-5c44-48d1-8394-535687bb6ae3] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=129953) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 02 10:57:32.638518 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [req-88184e2f-4880-4132-bbe0-68fe9fadde17 req-95dd7a5f-840b-454b-ba8d-955b8f2afdb5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb175839-504d-4d07-b576-d51202b9ccae", "tag": "801aec18-99a3-40f4-959b-068036dc0994"}]} {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:57:32.649053 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [req-88184e2f-4880-4132-bbe0-68fe9fadde17 req-95dd7a5f-840b-454b-ba8d-955b8f2afdb5 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:32.649749 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [req-88184e2f-4880-4132-bbe0-68fe9fadde17 req-95dd7a5f-840b-454b-ba8d-955b8f2afdb5 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:32.663134 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.compute.server_external_events [req-88184e2f-4880-4132-bbe0-68fe9fadde17 req-95dd7a5f-840b-454b-ba8d-955b8f2afdb5 service nova] Creating event network-changed:801aec18-99a3-40f4-959b-068036dc0994 for instance eb175839-504d-4d07-b576-d51202b9ccae on hv-cinder-85031 Aug 02 10:57:32.669229 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [req-88184e2f-4880-4132-bbe0-68fe9fadde17 req-95dd7a5f-840b-454b-ba8d-955b8f2afdb5 service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035386 Aug 02 10:57:32.670289 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 148/300] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Aug 2 10:57:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:57:32.940477 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-2c73b38d-0773-4384-9428-d7c0399a08c0 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "POST /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3/action" status: 202 len: 0 microversion: 2.20 time: 0.411295 Aug 02 10:57:32.941104 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 153/301] 10.222.0.115 () {62 vars in 1324 bytes} [Tue Aug 2 10:57:32 2022] POST /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3/action => generated 0 bytes in 413 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 02 10:57:32.951453 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-b5ff0660-7097-4905-983e-6bc761edc9e1 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:32.959768 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-b5ff0660-7097-4905-983e-6bc761edc9e1 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: b3a92fc5-5c44-48d1-8394-535687bb6ae3] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:32.960785 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-b5ff0660-7097-4905-983e-6bc761edc9e1 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:32.961282 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-b5ff0660-7097-4905-983e-6bc761edc9e1 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:32.962113 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-b5ff0660-7097-4905-983e-6bc761edc9e1 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:32.962571 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-b5ff0660-7097-4905-983e-6bc761edc9e1 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:33.101952 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-b5ff0660-7097-4905-983e-6bc761edc9e1 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:33.111830 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-b5ff0660-7097-4905-983e-6bc761edc9e1 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:33.113273 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-b5ff0660-7097-4905-983e-6bc761edc9e1 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:33.114472 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-b5ff0660-7097-4905-983e-6bc761edc9e1 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3" status: 200 len: 1755 microversion: 2.20 time: 0.169023 Aug 02 10:57:33.115031 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 149/302] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 10:57:32 2022] GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3 => generated 1755 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:57:33.282809 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG dbcounter [-] [129953] Writing DB stats nova_cell0:SELECT=2 {{(pid=129953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:57:33.287107 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-0ccfd47b-32a3-42e1-a38a-81b5a7de2826 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:33.287727 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-0ccfd47b-32a3-42e1-a38a-81b5a7de2826 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 454053f7-16a6-42c3-9ba0-ca0a40dc5c4b] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:33.294858 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-0ccfd47b-32a3-42e1-a38a-81b5a7de2826 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:33.295317 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-0ccfd47b-32a3-42e1-a38a-81b5a7de2826 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:33.298096 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-0ccfd47b-32a3-42e1-a38a-81b5a7de2826 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:33.298096 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-0ccfd47b-32a3-42e1-a38a-81b5a7de2826 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:33.475630 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-0ccfd47b-32a3-42e1-a38a-81b5a7de2826 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:33.483591 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-0ccfd47b-32a3-42e1-a38a-81b5a7de2826 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b" status: 200 len: 1526 microversion: 2.1 time: 0.201375 Aug 02 10:57:33.484182 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 154/303] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:57:33 2022] GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b => generated 1526 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:57:33.549842 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-e39f7b5d-2a99-4bc8-b49f-9f8bc60b4045 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:33.550394 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-e39f7b5d-2a99-4bc8-b49f-9f8bc60b4045 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] [instance: 3938932a-e778-4c0c-9ab0-78dc9082a48e] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:33.556755 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-e39f7b5d-2a99-4bc8-b49f-9f8bc60b4045 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:33.557967 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-e39f7b5d-2a99-4bc8-b49f-9f8bc60b4045 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:33.558748 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-e39f7b5d-2a99-4bc8-b49f-9f8bc60b4045 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:33.559234 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-e39f7b5d-2a99-4bc8-b49f-9f8bc60b4045 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:33.590061 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-60312321-6775-4937-b8fd-4e42d2105f19 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:33.590763 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-60312321-6775-4937-b8fd-4e42d2105f19 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] [instance: eb175839-504d-4d07-b576-d51202b9ccae] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:33.597201 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-60312321-6775-4937-b8fd-4e42d2105f19 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:33.597641 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-60312321-6775-4937-b8fd-4e42d2105f19 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:33.598404 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-60312321-6775-4937-b8fd-4e42d2105f19 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:33.598837 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-60312321-6775-4937-b8fd-4e42d2105f19 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:34.109439 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-e39f7b5d-2a99-4bc8-b49f-9f8bc60b4045 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f41f17f5154e01a699043edc350cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e92110a1545f1b84644b8971bb6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:34.117720 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-e39f7b5d-2a99-4bc8-b49f-9f8bc60b4045 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] 10.222.0.115 "GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e" status: 200 len: 1711 microversion: 2.1 time: 0.571776 Aug 02 10:57:34.118335 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 150/304] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:57:33 2022] GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e => generated 1711 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:57:34.125295 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-60312321-6775-4937-b8fd-4e42d2105f19 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914de37664914b4cb91e0ce2c3a0e1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66234794284419a47e3afcae968084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:34.139870 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-39aad1fc-3873-4d92-bbe8-b16e7cbf1651 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:34.140348 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-60312321-6775-4937-b8fd-4e42d2105f19 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] 10.222.0.115 "GET /compute/v2.1/servers/eb175839-504d-4d07-b576-d51202b9ccae" status: 200 len: 1270 microversion: 2.1 time: 0.553886 Aug 02 10:57:34.140507 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-39aad1fc-3873-4d92-bbe8-b16e7cbf1651 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: b3a92fc5-5c44-48d1-8394-535687bb6ae3] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:34.141596 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 155/305] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:57:33 2022] GET /compute/v2.1/servers/eb175839-504d-4d07-b576-d51202b9ccae => generated 1270 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:57:34.147168 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-39aad1fc-3873-4d92-bbe8-b16e7cbf1651 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:34.147615 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-39aad1fc-3873-4d92-bbe8-b16e7cbf1651 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:34.148539 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-39aad1fc-3873-4d92-bbe8-b16e7cbf1651 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:34.148929 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-39aad1fc-3873-4d92-bbe8-b16e7cbf1651 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:34.300575 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-39aad1fc-3873-4d92-bbe8-b16e7cbf1651 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:34.310651 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-39aad1fc-3873-4d92-bbe8-b16e7cbf1651 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:34.312336 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-39aad1fc-3873-4d92-bbe8-b16e7cbf1651 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:34.314871 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-39aad1fc-3873-4d92-bbe8-b16e7cbf1651 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3" status: 200 len: 1755 microversion: 2.20 time: 0.180576 Aug 02 10:57:34.318392 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 151/306] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 10:57:34 2022] GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3 => generated 1755 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:57:34.504582 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-b240173a-d4b3-42bb-b5fb-9989e52b1c15 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:34.505201 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-b240173a-d4b3-42bb-b5fb-9989e52b1c15 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 454053f7-16a6-42c3-9ba0-ca0a40dc5c4b] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:34.513549 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-b240173a-d4b3-42bb-b5fb-9989e52b1c15 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:34.513991 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-b240173a-d4b3-42bb-b5fb-9989e52b1c15 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:34.514766 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-b240173a-d4b3-42bb-b5fb-9989e52b1c15 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:34.515247 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-b240173a-d4b3-42bb-b5fb-9989e52b1c15 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:34.667165 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-b240173a-d4b3-42bb-b5fb-9989e52b1c15 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:34.675111 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-b240173a-d4b3-42bb-b5fb-9989e52b1c15 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b" status: 200 len: 1526 microversion: 2.1 time: 0.174533 Aug 02 10:57:34.675691 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 156/307] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:57:34 2022] GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b => generated 1526 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:57:35.140470 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-8533ee57-85fc-4b55-bbc0-4d217f58aff1 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:35.141032 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-8533ee57-85fc-4b55-bbc0-4d217f58aff1 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] [instance: 3938932a-e778-4c0c-9ab0-78dc9082a48e] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:35.148072 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-8533ee57-85fc-4b55-bbc0-4d217f58aff1 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:35.148521 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-8533ee57-85fc-4b55-bbc0-4d217f58aff1 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:35.149399 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-8533ee57-85fc-4b55-bbc0-4d217f58aff1 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:35.149814 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-8533ee57-85fc-4b55-bbc0-4d217f58aff1 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:35.171503 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-91b94321-83fd-47dc-a348-3aba64b8f817 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:35.172361 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-91b94321-83fd-47dc-a348-3aba64b8f817 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] [instance: eb175839-504d-4d07-b576-d51202b9ccae] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:35.178501 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-91b94321-83fd-47dc-a348-3aba64b8f817 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:35.178934 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-91b94321-83fd-47dc-a348-3aba64b8f817 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:35.179857 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-91b94321-83fd-47dc-a348-3aba64b8f817 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:35.180281 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-91b94321-83fd-47dc-a348-3aba64b8f817 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:35.367786 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-8533ee57-85fc-4b55-bbc0-4d217f58aff1 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f41f17f5154e01a699043edc350cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e92110a1545f1b84644b8971bb6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:35.372546 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG dbcounter [-] [129952] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:57:35.378313 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-8533ee57-85fc-4b55-bbc0-4d217f58aff1 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] 10.222.0.115 "GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e" status: 200 len: 1715 microversion: 2.1 time: 0.242013 Aug 02 10:57:35.379169 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 152/308] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:57:35 2022] GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e => generated 1715 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:57:35.384434 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-4fdc4f87-8955-4e25-97d8-9de373294216 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:35.385011 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-4fdc4f87-8955-4e25-97d8-9de373294216 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: b3a92fc5-5c44-48d1-8394-535687bb6ae3] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:35.387620 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-91b94321-83fd-47dc-a348-3aba64b8f817 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914de37664914b4cb91e0ce2c3a0e1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66234794284419a47e3afcae968084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:35.391888 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-4fdc4f87-8955-4e25-97d8-9de373294216 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:35.392302 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG dbcounter [-] [129953] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=129953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:57:35.392587 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-4fdc4f87-8955-4e25-97d8-9de373294216 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:35.393902 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-4fdc4f87-8955-4e25-97d8-9de373294216 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:35.394433 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-4fdc4f87-8955-4e25-97d8-9de373294216 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:35.398405 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-91b94321-83fd-47dc-a348-3aba64b8f817 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] 10.222.0.115 "GET /compute/v2.1/servers/eb175839-504d-4d07-b576-d51202b9ccae" status: 200 len: 1270 microversion: 2.1 time: 0.230791 Aug 02 10:57:35.399096 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 157/309] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:57:35 2022] GET /compute/v2.1/servers/eb175839-504d-4d07-b576-d51202b9ccae => generated 1270 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:57:35.550197 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-4fdc4f87-8955-4e25-97d8-9de373294216 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:35.559891 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-4fdc4f87-8955-4e25-97d8-9de373294216 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:35.561411 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-4fdc4f87-8955-4e25-97d8-9de373294216 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:35.562585 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-4fdc4f87-8955-4e25-97d8-9de373294216 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3" status: 200 len: 1755 microversion: 2.20 time: 0.182478 Aug 02 10:57:35.564726 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 153/310] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 10:57:35 2022] GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3 => generated 1755 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:57:35.698285 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-e6702895-f264-48b7-9071-854cd7997bd9 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:35.698855 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-e6702895-f264-48b7-9071-854cd7997bd9 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 454053f7-16a6-42c3-9ba0-ca0a40dc5c4b] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:35.700743 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG dbcounter [-] [129953] Writing DB stats nova_cell0:SELECT=10 {{(pid=129953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:57:35.707152 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-e6702895-f264-48b7-9071-854cd7997bd9 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:35.707601 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-e6702895-f264-48b7-9071-854cd7997bd9 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:35.708377 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-e6702895-f264-48b7-9071-854cd7997bd9 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:35.709017 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-e6702895-f264-48b7-9071-854cd7997bd9 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:35.853493 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-e6702895-f264-48b7-9071-854cd7997bd9 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:35.861547 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-e6702895-f264-48b7-9071-854cd7997bd9 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b" status: 200 len: 1526 microversion: 2.1 time: 0.168418 Aug 02 10:57:35.862119 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 158/311] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:57:35 2022] GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b => generated 1526 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:57:36.420985 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-32948208-8c3a-4838-9f24-295a1886e98c tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:36.421630 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-32948208-8c3a-4838-9f24-295a1886e98c tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] [instance: eb175839-504d-4d07-b576-d51202b9ccae] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:36.427729 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-32948208-8c3a-4838-9f24-295a1886e98c tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:36.428182 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-32948208-8c3a-4838-9f24-295a1886e98c tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:36.428942 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-32948208-8c3a-4838-9f24-295a1886e98c tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:36.429381 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-32948208-8c3a-4838-9f24-295a1886e98c tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:36.570572 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-32948208-8c3a-4838-9f24-295a1886e98c tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914de37664914b4cb91e0ce2c3a0e1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66234794284419a47e3afcae968084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:36.578504 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-32948208-8c3a-4838-9f24-295a1886e98c tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] 10.222.0.115 "GET /compute/v2.1/servers/eb175839-504d-4d07-b576-d51202b9ccae" status: 200 len: 1270 microversion: 2.1 time: 0.162127 Aug 02 10:57:36.579292 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 154/312] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:57:36 2022] GET /compute/v2.1/servers/eb175839-504d-4d07-b576-d51202b9ccae => generated 1270 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:57:36.587741 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-c92cd09a-cd39-454b-bb9a-b120db9eee83 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:36.589009 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-c92cd09a-cd39-454b-bb9a-b120db9eee83 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: b3a92fc5-5c44-48d1-8394-535687bb6ae3] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:36.594970 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-c92cd09a-cd39-454b-bb9a-b120db9eee83 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:36.595438 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-c92cd09a-cd39-454b-bb9a-b120db9eee83 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:36.596182 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-c92cd09a-cd39-454b-bb9a-b120db9eee83 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:36.596609 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-c92cd09a-cd39-454b-bb9a-b120db9eee83 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:36.733589 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-c92cd09a-cd39-454b-bb9a-b120db9eee83 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:36.742310 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-c92cd09a-cd39-454b-bb9a-b120db9eee83 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:36.743844 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-c92cd09a-cd39-454b-bb9a-b120db9eee83 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:36.745659 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-c92cd09a-cd39-454b-bb9a-b120db9eee83 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3" status: 200 len: 1755 microversion: 2.20 time: 0.161875 Aug 02 10:57:36.746207 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 159/313] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 10:57:36 2022] GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3 => generated 1755 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:57:36.884690 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-ae16cc4e-41a3-42cb-ad07-0ecea87a6be1 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:36.885216 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-ae16cc4e-41a3-42cb-ad07-0ecea87a6be1 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 454053f7-16a6-42c3-9ba0-ca0a40dc5c4b] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:36.891927 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-ae16cc4e-41a3-42cb-ad07-0ecea87a6be1 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:36.892372 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-ae16cc4e-41a3-42cb-ad07-0ecea87a6be1 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:36.893147 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-ae16cc4e-41a3-42cb-ad07-0ecea87a6be1 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:36.893578 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-ae16cc4e-41a3-42cb-ad07-0ecea87a6be1 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:37.028332 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-ae16cc4e-41a3-42cb-ad07-0ecea87a6be1 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:37.036619 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-ae16cc4e-41a3-42cb-ad07-0ecea87a6be1 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b" status: 200 len: 1526 microversion: 2.1 time: 0.156276 Aug 02 10:57:37.038046 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 155/314] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:57:36 2022] GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b => generated 1526 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:57:37.600177 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-dcbffcd6-2c46-478c-8952-95c9e6959f21 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:37.600685 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-dcbffcd6-2c46-478c-8952-95c9e6959f21 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] [instance: eb175839-504d-4d07-b576-d51202b9ccae] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:37.606868 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-dcbffcd6-2c46-478c-8952-95c9e6959f21 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:37.607351 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-dcbffcd6-2c46-478c-8952-95c9e6959f21 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:37.608097 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-dcbffcd6-2c46-478c-8952-95c9e6959f21 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:37.608521 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-dcbffcd6-2c46-478c-8952-95c9e6959f21 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:37.745291 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-dcbffcd6-2c46-478c-8952-95c9e6959f21 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914de37664914b4cb91e0ce2c3a0e1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66234794284419a47e3afcae968084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:37.754453 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-dcbffcd6-2c46-478c-8952-95c9e6959f21 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] 10.222.0.115 "GET /compute/v2.1/servers/eb175839-504d-4d07-b576-d51202b9ccae" status: 200 len: 1270 microversion: 2.1 time: 0.158206 Aug 02 10:57:37.758829 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 160/315] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:57:37 2022] GET /compute/v2.1/servers/eb175839-504d-4d07-b576-d51202b9ccae => generated 1270 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:57:37.770118 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-196076c6-3663-40b9-8224-7ad5600db564 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:37.770729 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-196076c6-3663-40b9-8224-7ad5600db564 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: b3a92fc5-5c44-48d1-8394-535687bb6ae3] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:37.778102 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-196076c6-3663-40b9-8224-7ad5600db564 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:37.825830 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-196076c6-3663-40b9-8224-7ad5600db564 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:37.825830 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-196076c6-3663-40b9-8224-7ad5600db564 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:37.825830 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-196076c6-3663-40b9-8224-7ad5600db564 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:37.917107 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-196076c6-3663-40b9-8224-7ad5600db564 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:37.926644 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-196076c6-3663-40b9-8224-7ad5600db564 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:37.928168 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-196076c6-3663-40b9-8224-7ad5600db564 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:37.929314 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-196076c6-3663-40b9-8224-7ad5600db564 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3" status: 200 len: 1755 microversion: 2.20 time: 0.163420 Aug 02 10:57:37.930188 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 156/316] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 10:57:37 2022] GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3 => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:57:38.060498 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-49a8d717-5317-44a3-a83a-61468ec2ca8e tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:38.061111 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-49a8d717-5317-44a3-a83a-61468ec2ca8e tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 454053f7-16a6-42c3-9ba0-ca0a40dc5c4b] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:38.067292 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-49a8d717-5317-44a3-a83a-61468ec2ca8e tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:38.067748 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-49a8d717-5317-44a3-a83a-61468ec2ca8e tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:38.068511 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-49a8d717-5317-44a3-a83a-61468ec2ca8e tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:38.068947 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-49a8d717-5317-44a3-a83a-61468ec2ca8e tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:38.207714 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-49a8d717-5317-44a3-a83a-61468ec2ca8e tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:38.215247 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-49a8d717-5317-44a3-a83a-61468ec2ca8e tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b" status: 200 len: 1526 microversion: 2.1 time: 0.159369 Aug 02 10:57:38.215806 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 161/317] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:57:38 2022] GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b => generated 1526 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:57:38.777101 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-b73dc492-b794-4b8b-be70-0ac7e79ee7b6 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:38.778417 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-b73dc492-b794-4b8b-be70-0ac7e79ee7b6 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] [instance: eb175839-504d-4d07-b576-d51202b9ccae] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:38.785444 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-b73dc492-b794-4b8b-be70-0ac7e79ee7b6 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:38.785894 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-b73dc492-b794-4b8b-be70-0ac7e79ee7b6 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:38.786934 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-b73dc492-b794-4b8b-be70-0ac7e79ee7b6 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:38.787494 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-b73dc492-b794-4b8b-be70-0ac7e79ee7b6 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:38.923456 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-b73dc492-b794-4b8b-be70-0ac7e79ee7b6 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914de37664914b4cb91e0ce2c3a0e1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66234794284419a47e3afcae968084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:38.930987 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-b73dc492-b794-4b8b-be70-0ac7e79ee7b6 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] 10.222.0.115 "GET /compute/v2.1/servers/eb175839-504d-4d07-b576-d51202b9ccae" status: 200 len: 1270 microversion: 2.1 time: 0.158020 Aug 02 10:57:38.931574 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 157/318] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:57:38 2022] GET /compute/v2.1/servers/eb175839-504d-4d07-b576-d51202b9ccae => generated 1270 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:57:38.954318 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-1e2e711e-06ec-4037-88a5-10e1d27ffe36 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:38.954926 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-1e2e711e-06ec-4037-88a5-10e1d27ffe36 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: b3a92fc5-5c44-48d1-8394-535687bb6ae3] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:38.961697 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-1e2e711e-06ec-4037-88a5-10e1d27ffe36 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:38.962146 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-1e2e711e-06ec-4037-88a5-10e1d27ffe36 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:38.962906 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-1e2e711e-06ec-4037-88a5-10e1d27ffe36 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:38.963383 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-1e2e711e-06ec-4037-88a5-10e1d27ffe36 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:39.096521 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-1e2e711e-06ec-4037-88a5-10e1d27ffe36 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:39.106271 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-1e2e711e-06ec-4037-88a5-10e1d27ffe36 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:39.108217 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-1e2e711e-06ec-4037-88a5-10e1d27ffe36 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:39.109392 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-1e2e711e-06ec-4037-88a5-10e1d27ffe36 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3" status: 200 len: 1755 microversion: 2.20 time: 0.159100 Aug 02 10:57:39.109953 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 162/319] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 10:57:38 2022] GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3 => generated 1755 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:57:39.236934 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-ce821397-431c-40d0-bb78-6c4cfd05a077 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:39.237578 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-ce821397-431c-40d0-bb78-6c4cfd05a077 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 454053f7-16a6-42c3-9ba0-ca0a40dc5c4b] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:39.243838 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-ce821397-431c-40d0-bb78-6c4cfd05a077 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:39.244290 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-ce821397-431c-40d0-bb78-6c4cfd05a077 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:39.245057 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-ce821397-431c-40d0-bb78-6c4cfd05a077 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:39.245496 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-ce821397-431c-40d0-bb78-6c4cfd05a077 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:39.376834 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-ce821397-431c-40d0-bb78-6c4cfd05a077 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:39.385246 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-ce821397-431c-40d0-bb78-6c4cfd05a077 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b" status: 200 len: 1526 microversion: 2.1 time: 0.152339 Aug 02 10:57:39.385828 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 158/320] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:57:39 2022] GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b => generated 1526 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:57:39.951767 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-37747dbe-4c41-4149-9a0a-49fb02bcf8c8 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:39.952382 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-37747dbe-4c41-4149-9a0a-49fb02bcf8c8 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] [instance: eb175839-504d-4d07-b576-d51202b9ccae] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:39.960603 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-37747dbe-4c41-4149-9a0a-49fb02bcf8c8 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:39.964282 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-37747dbe-4c41-4149-9a0a-49fb02bcf8c8 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:39.964282 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-37747dbe-4c41-4149-9a0a-49fb02bcf8c8 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:39.964282 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-37747dbe-4c41-4149-9a0a-49fb02bcf8c8 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:40.114822 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-37747dbe-4c41-4149-9a0a-49fb02bcf8c8 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914de37664914b4cb91e0ce2c3a0e1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66234794284419a47e3afcae968084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:40.124230 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-37747dbe-4c41-4149-9a0a-49fb02bcf8c8 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] 10.222.0.115 "GET /compute/v2.1/servers/eb175839-504d-4d07-b576-d51202b9ccae" status: 200 len: 1270 microversion: 2.1 time: 0.176440 Aug 02 10:57:40.124813 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 163/321] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:57:39 2022] GET /compute/v2.1/servers/eb175839-504d-4d07-b576-d51202b9ccae => generated 1270 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:57:40.134484 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-03f2dc87-76bf-4598-b55a-d0618912178a tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:40.138449 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-03f2dc87-76bf-4598-b55a-d0618912178a tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: b3a92fc5-5c44-48d1-8394-535687bb6ae3] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:40.145479 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-03f2dc87-76bf-4598-b55a-d0618912178a tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:40.146062 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-03f2dc87-76bf-4598-b55a-d0618912178a tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:40.146937 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-03f2dc87-76bf-4598-b55a-d0618912178a tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:40.147401 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-03f2dc87-76bf-4598-b55a-d0618912178a tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:40.295420 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-03f2dc87-76bf-4598-b55a-d0618912178a tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:40.312882 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-03f2dc87-76bf-4598-b55a-d0618912178a tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:40.312882 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-03f2dc87-76bf-4598-b55a-d0618912178a tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:40.312882 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-03f2dc87-76bf-4598-b55a-d0618912178a tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3" status: 200 len: 1755 microversion: 2.20 time: 0.181705 Aug 02 10:57:40.314490 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 159/322] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 10:57:40 2022] GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3 => generated 1755 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:57:40.407243 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-9e19f79d-3500-463e-957a-fd90f362db7a tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:40.407850 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-9e19f79d-3500-463e-957a-fd90f362db7a tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 454053f7-16a6-42c3-9ba0-ca0a40dc5c4b] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:40.415720 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-9e19f79d-3500-463e-957a-fd90f362db7a tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:40.416352 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-9e19f79d-3500-463e-957a-fd90f362db7a tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:40.417251 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-9e19f79d-3500-463e-957a-fd90f362db7a tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:40.417755 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-9e19f79d-3500-463e-957a-fd90f362db7a tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:40.578157 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-9e19f79d-3500-463e-957a-fd90f362db7a tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:40.587663 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-9e19f79d-3500-463e-957a-fd90f362db7a tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b" status: 200 len: 1526 microversion: 2.1 time: 0.184764 Aug 02 10:57:40.588514 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 164/323] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:57:40 2022] GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b => generated 1526 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:57:41.146955 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-cc976529-738f-4791-ac97-e4a5a86ef269 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:41.147749 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-cc976529-738f-4791-ac97-e4a5a86ef269 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] [instance: eb175839-504d-4d07-b576-d51202b9ccae] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:41.154595 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-cc976529-738f-4791-ac97-e4a5a86ef269 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:41.155167 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-cc976529-738f-4791-ac97-e4a5a86ef269 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:41.156052 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-cc976529-738f-4791-ac97-e4a5a86ef269 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:41.156562 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-cc976529-738f-4791-ac97-e4a5a86ef269 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:41.294155 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-cc976529-738f-4791-ac97-e4a5a86ef269 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914de37664914b4cb91e0ce2c3a0e1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66234794284419a47e3afcae968084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:41.301944 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-cc976529-738f-4791-ac97-e4a5a86ef269 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] 10.222.0.115 "GET /compute/v2.1/servers/eb175839-504d-4d07-b576-d51202b9ccae" status: 200 len: 1270 microversion: 2.1 time: 0.158839 Aug 02 10:57:41.302505 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 160/324] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:57:41 2022] GET /compute/v2.1/servers/eb175839-504d-4d07-b576-d51202b9ccae => generated 1270 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:57:41.337647 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-7c6f3f4f-0864-4a69-a71f-8ed16b2ade69 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:41.337647 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-7c6f3f4f-0864-4a69-a71f-8ed16b2ade69 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: b3a92fc5-5c44-48d1-8394-535687bb6ae3] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:41.343171 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-7c6f3f4f-0864-4a69-a71f-8ed16b2ade69 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:41.343822 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-7c6f3f4f-0864-4a69-a71f-8ed16b2ade69 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:41.344620 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-7c6f3f4f-0864-4a69-a71f-8ed16b2ade69 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:41.345059 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-7c6f3f4f-0864-4a69-a71f-8ed16b2ade69 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:41.475434 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-7c6f3f4f-0864-4a69-a71f-8ed16b2ade69 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:41.484508 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-7c6f3f4f-0864-4a69-a71f-8ed16b2ade69 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:41.486023 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-7c6f3f4f-0864-4a69-a71f-8ed16b2ade69 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:41.487318 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-7c6f3f4f-0864-4a69-a71f-8ed16b2ade69 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3" status: 200 len: 1755 microversion: 2.20 time: 0.155528 Aug 02 10:57:41.487876 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 165/325] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 10:57:41 2022] GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3 => generated 1755 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:57:41.610302 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-efa363af-801f-4d14-a279-ba0cb1155037 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:41.610930 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-efa363af-801f-4d14-a279-ba0cb1155037 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 454053f7-16a6-42c3-9ba0-ca0a40dc5c4b] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:41.616965 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-efa363af-801f-4d14-a279-ba0cb1155037 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:41.617527 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-efa363af-801f-4d14-a279-ba0cb1155037 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:41.618206 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-efa363af-801f-4d14-a279-ba0cb1155037 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:41.618707 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-efa363af-801f-4d14-a279-ba0cb1155037 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:41.755721 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-efa363af-801f-4d14-a279-ba0cb1155037 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:41.763680 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-efa363af-801f-4d14-a279-ba0cb1155037 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b" status: 200 len: 1526 microversion: 2.1 time: 0.158000 Aug 02 10:57:41.764252 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 161/326] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:57:41 2022] GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b => generated 1526 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:57:42.337046 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-8e9e5b92-aa02-47c1-b15b-09cf97f684d9 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:42.337662 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-8e9e5b92-aa02-47c1-b15b-09cf97f684d9 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] [instance: eb175839-504d-4d07-b576-d51202b9ccae] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:42.351524 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-8e9e5b92-aa02-47c1-b15b-09cf97f684d9 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:42.352112 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-8e9e5b92-aa02-47c1-b15b-09cf97f684d9 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:42.353076 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-8e9e5b92-aa02-47c1-b15b-09cf97f684d9 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:42.353736 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-8e9e5b92-aa02-47c1-b15b-09cf97f684d9 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:42.510081 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-ac1296d8-c51e-45e3-95ba-6841b3c35312 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:42.510707 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-ac1296d8-c51e-45e3-95ba-6841b3c35312 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: b3a92fc5-5c44-48d1-8394-535687bb6ae3] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:42.518025 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-ac1296d8-c51e-45e3-95ba-6841b3c35312 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:42.518485 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-ac1296d8-c51e-45e3-95ba-6841b3c35312 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:42.526940 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-ac1296d8-c51e-45e3-95ba-6841b3c35312 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:42.526940 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-ac1296d8-c51e-45e3-95ba-6841b3c35312 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:42.527363 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-8e9e5b92-aa02-47c1-b15b-09cf97f684d9 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914de37664914b4cb91e0ce2c3a0e1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66234794284419a47e3afcae968084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:42.533510 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-8e9e5b92-aa02-47c1-b15b-09cf97f684d9 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] 10.222.0.115 "GET /compute/v2.1/servers/eb175839-504d-4d07-b576-d51202b9ccae" status: 200 len: 1270 microversion: 2.1 time: 0.213016 Aug 02 10:57:42.534347 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 166/327] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:57:42 2022] GET /compute/v2.1/servers/eb175839-504d-4d07-b576-d51202b9ccae => generated 1270 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:57:42.657693 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-ac1296d8-c51e-45e3-95ba-6841b3c35312 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:42.671190 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-ac1296d8-c51e-45e3-95ba-6841b3c35312 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:42.674279 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-ac1296d8-c51e-45e3-95ba-6841b3c35312 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:42.676606 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-ac1296d8-c51e-45e3-95ba-6841b3c35312 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3" status: 200 len: 1755 microversion: 2.20 time: 0.170135 Aug 02 10:57:42.679097 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 162/328] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 10:57:42 2022] GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3 => generated 1755 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:57:42.785202 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-df46e4d1-17eb-47fb-ac37-21485ddb1105 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:42.785816 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-df46e4d1-17eb-47fb-ac37-21485ddb1105 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 454053f7-16a6-42c3-9ba0-ca0a40dc5c4b] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:42.792190 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-df46e4d1-17eb-47fb-ac37-21485ddb1105 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:42.794860 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-df46e4d1-17eb-47fb-ac37-21485ddb1105 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:42.794860 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-df46e4d1-17eb-47fb-ac37-21485ddb1105 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:42.794860 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-df46e4d1-17eb-47fb-ac37-21485ddb1105 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:42.930219 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-df46e4d1-17eb-47fb-ac37-21485ddb1105 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:42.938601 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-df46e4d1-17eb-47fb-ac37-21485ddb1105 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b" status: 200 len: 1526 microversion: 2.1 time: 0.157824 Aug 02 10:57:42.939233 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 167/329] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:57:42 2022] GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b => generated 1526 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:57:43.554773 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-d248d463-6f7c-4345-b776-7715010df1b1 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:43.555408 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-d248d463-6f7c-4345-b776-7715010df1b1 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] [instance: eb175839-504d-4d07-b576-d51202b9ccae] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:43.562138 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-d248d463-6f7c-4345-b776-7715010df1b1 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:43.562608 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-d248d463-6f7c-4345-b776-7715010df1b1 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:43.563415 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-d248d463-6f7c-4345-b776-7715010df1b1 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:43.563846 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-d248d463-6f7c-4345-b776-7715010df1b1 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:43.701986 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-07b07ac8-f0d0-44fb-a374-519a848cef57 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:43.704936 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-07b07ac8-f0d0-44fb-a374-519a848cef57 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: b3a92fc5-5c44-48d1-8394-535687bb6ae3] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:43.709620 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-d248d463-6f7c-4345-b776-7715010df1b1 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914de37664914b4cb91e0ce2c3a0e1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66234794284419a47e3afcae968084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:43.712685 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-07b07ac8-f0d0-44fb-a374-519a848cef57 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:43.713522 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-07b07ac8-f0d0-44fb-a374-519a848cef57 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:43.714437 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-07b07ac8-f0d0-44fb-a374-519a848cef57 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:43.715080 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-07b07ac8-f0d0-44fb-a374-519a848cef57 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:43.717757 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-d248d463-6f7c-4345-b776-7715010df1b1 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] 10.222.0.115 "GET /compute/v2.1/servers/eb175839-504d-4d07-b576-d51202b9ccae" status: 200 len: 1270 microversion: 2.1 time: 0.166815 Aug 02 10:57:43.718715 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 163/330] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:57:43 2022] GET /compute/v2.1/servers/eb175839-504d-4d07-b576-d51202b9ccae => generated 1270 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:57:43.851123 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-07b07ac8-f0d0-44fb-a374-519a848cef57 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:43.860037 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-07b07ac8-f0d0-44fb-a374-519a848cef57 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:43.861635 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-07b07ac8-f0d0-44fb-a374-519a848cef57 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:43.862858 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-07b07ac8-f0d0-44fb-a374-519a848cef57 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3" status: 200 len: 1757 microversion: 2.20 time: 0.166156 Aug 02 10:57:43.863449 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 168/331] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 10:57:43 2022] GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3 => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:57:43.959623 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-4836d1b0-ea88-402c-ae36-2e1e0ca50b81 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:43.960596 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-4836d1b0-ea88-402c-ae36-2e1e0ca50b81 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 454053f7-16a6-42c3-9ba0-ca0a40dc5c4b] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:43.967730 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-4836d1b0-ea88-402c-ae36-2e1e0ca50b81 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:43.968174 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-4836d1b0-ea88-402c-ae36-2e1e0ca50b81 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:43.968942 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-4836d1b0-ea88-402c-ae36-2e1e0ca50b81 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:43.969374 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-4836d1b0-ea88-402c-ae36-2e1e0ca50b81 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:44.114851 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-4836d1b0-ea88-402c-ae36-2e1e0ca50b81 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:44.123611 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-4836d1b0-ea88-402c-ae36-2e1e0ca50b81 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b" status: 200 len: 1526 microversion: 2.1 time: 0.167865 Aug 02 10:57:44.124190 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 164/332] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:57:43 2022] GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b => generated 1526 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:57:44.740161 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-a763117a-6b71-4730-a785-13641970cc26 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:44.740700 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-a763117a-6b71-4730-a785-13641970cc26 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] [instance: eb175839-504d-4d07-b576-d51202b9ccae] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:44.748699 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-a763117a-6b71-4730-a785-13641970cc26 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:44.749152 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-a763117a-6b71-4730-a785-13641970cc26 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:44.749927 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-a763117a-6b71-4730-a785-13641970cc26 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:44.750434 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-a763117a-6b71-4730-a785-13641970cc26 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:44.886981 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-51399e73-0804-4938-805a-3308fd4721d2 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:44.888548 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-51399e73-0804-4938-805a-3308fd4721d2 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: b3a92fc5-5c44-48d1-8394-535687bb6ae3] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:44.891281 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-a763117a-6b71-4730-a785-13641970cc26 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914de37664914b4cb91e0ce2c3a0e1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66234794284419a47e3afcae968084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:44.895381 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-51399e73-0804-4938-805a-3308fd4721d2 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:44.895915 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-51399e73-0804-4938-805a-3308fd4721d2 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:44.896700 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-51399e73-0804-4938-805a-3308fd4721d2 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:44.897134 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-51399e73-0804-4938-805a-3308fd4721d2 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:44.899925 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-a763117a-6b71-4730-a785-13641970cc26 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] 10.222.0.115 "GET /compute/v2.1/servers/eb175839-504d-4d07-b576-d51202b9ccae" status: 200 len: 1270 microversion: 2.1 time: 0.164232 Aug 02 10:57:44.901314 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 169/333] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:57:44 2022] GET /compute/v2.1/servers/eb175839-504d-4d07-b576-d51202b9ccae => generated 1270 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:57:45.034680 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-51399e73-0804-4938-805a-3308fd4721d2 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:45.043165 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-51399e73-0804-4938-805a-3308fd4721d2 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:45.045571 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-51399e73-0804-4938-805a-3308fd4721d2 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:45.046929 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-51399e73-0804-4938-805a-3308fd4721d2 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3" status: 200 len: 1757 microversion: 2.20 time: 0.163826 Aug 02 10:57:45.047523 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 165/334] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 10:57:44 2022] GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3 => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:57:45.144506 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-3739c2bc-d3bb-4210-b75b-08fa85495db3 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:45.145139 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-3739c2bc-d3bb-4210-b75b-08fa85495db3 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 454053f7-16a6-42c3-9ba0-ca0a40dc5c4b] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:45.151833 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-3739c2bc-d3bb-4210-b75b-08fa85495db3 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:45.153192 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-3739c2bc-d3bb-4210-b75b-08fa85495db3 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:45.153192 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-3739c2bc-d3bb-4210-b75b-08fa85495db3 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:45.153514 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-3739c2bc-d3bb-4210-b75b-08fa85495db3 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:45.214735 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [req-82171565-c9b6-4a04-9158-ba38b2925f7a req-f0a188bf-b399-462b-9bb4-c7254a864600 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb175839-504d-4d07-b576-d51202b9ccae", "name": "network-vif-plugged", "status": "completed", "tag": "801aec18-99a3-40f4-959b-068036dc0994"}]} {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:57:45.225851 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [req-82171565-c9b6-4a04-9158-ba38b2925f7a req-f0a188bf-b399-462b-9bb4-c7254a864600 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:45.226553 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [req-82171565-c9b6-4a04-9158-ba38b2925f7a req-f0a188bf-b399-462b-9bb4-c7254a864600 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:45.238987 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.compute.server_external_events [req-82171565-c9b6-4a04-9158-ba38b2925f7a req-f0a188bf-b399-462b-9bb4-c7254a864600 service nova] Creating event network-vif-plugged:801aec18-99a3-40f4-959b-068036dc0994 for instance eb175839-504d-4d07-b576-d51202b9ccae on hv-cinder-85031 Aug 02 10:57:45.243983 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [req-82171565-c9b6-4a04-9158-ba38b2925f7a req-f0a188bf-b399-462b-9bb4-c7254a864600 service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033563 Aug 02 10:57:45.244591 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 166/335] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Aug 2 10:57:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:57:45.310042 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-3739c2bc-d3bb-4210-b75b-08fa85495db3 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:45.317319 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-3739c2bc-d3bb-4210-b75b-08fa85495db3 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b" status: 200 len: 1506 microversion: 2.1 time: 0.176700 Aug 02 10:57:45.317884 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 170/336] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:57:45 2022] GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b => generated 1506 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:57:45.345734 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-5270b162-8c78-4711-972c-6aa6a7b2e811 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:45.345734 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-5270b162-8c78-4711-972c-6aa6a7b2e811 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: e7deeb40-9fc3-40f8-b564-192fe68fa113] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:45.347315 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-5270b162-8c78-4711-972c-6aa6a7b2e811 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:45.347773 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-5270b162-8c78-4711-972c-6aa6a7b2e811 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:45.348540 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-5270b162-8c78-4711-972c-6aa6a7b2e811 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:45.348975 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-5270b162-8c78-4711-972c-6aa6a7b2e811 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:45.495365 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-5270b162-8c78-4711-972c-6aa6a7b2e811 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:45.506663 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-5270b162-8c78-4711-972c-6aa6a7b2e811 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/e7deeb40-9fc3-40f8-b564-192fe68fa113" status: 200 len: 1519 microversion: 2.1 time: 0.171499 Aug 02 10:57:45.507452 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 167/337] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:57:45 2022] GET /compute/v2.1/servers/e7deeb40-9fc3-40f8-b564-192fe68fa113 => generated 1519 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:57:45.923767 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-a4ae8a97-7dcc-4dc1-99ba-0e76c13cea82 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:45.924450 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-a4ae8a97-7dcc-4dc1-99ba-0e76c13cea82 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] [instance: eb175839-504d-4d07-b576-d51202b9ccae] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:45.931620 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-a4ae8a97-7dcc-4dc1-99ba-0e76c13cea82 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:45.932231 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-a4ae8a97-7dcc-4dc1-99ba-0e76c13cea82 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:45.933103 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-a4ae8a97-7dcc-4dc1-99ba-0e76c13cea82 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:45.933606 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-a4ae8a97-7dcc-4dc1-99ba-0e76c13cea82 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:46.071751 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-e2405cdc-d317-4c01-b9e0-16698406e915 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:46.072428 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-e2405cdc-d317-4c01-b9e0-16698406e915 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: b3a92fc5-5c44-48d1-8394-535687bb6ae3] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:46.102326 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-e2405cdc-d317-4c01-b9e0-16698406e915 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:46.102985 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-e2405cdc-d317-4c01-b9e0-16698406e915 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:46.103825 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-e2405cdc-d317-4c01-b9e0-16698406e915 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:46.104253 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-e2405cdc-d317-4c01-b9e0-16698406e915 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:46.191992 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-a4ae8a97-7dcc-4dc1-99ba-0e76c13cea82 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914de37664914b4cb91e0ce2c3a0e1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66234794284419a47e3afcae968084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:46.204697 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-a4ae8a97-7dcc-4dc1-99ba-0e76c13cea82 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] 10.222.0.115 "GET /compute/v2.1/servers/eb175839-504d-4d07-b576-d51202b9ccae" status: 200 len: 1270 microversion: 2.1 time: 0.284789 Aug 02 10:57:46.205893 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 171/338] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:57:45 2022] GET /compute/v2.1/servers/eb175839-504d-4d07-b576-d51202b9ccae => generated 1270 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:57:46.279949 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-e2405cdc-d317-4c01-b9e0-16698406e915 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:46.289496 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-e2405cdc-d317-4c01-b9e0-16698406e915 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:46.291173 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-e2405cdc-d317-4c01-b9e0-16698406e915 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:46.295034 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-e2405cdc-d317-4c01-b9e0-16698406e915 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3" status: 200 len: 1813 microversion: 2.20 time: 0.224673 Aug 02 10:57:46.295034 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 168/339] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 10:57:46 2022] GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3 => generated 1813 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:57:47.225652 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-a49f136f-8388-4e10-80ec-311a70ec8741 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:57:47.226637 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-84279e1d-a246-470f-9c03-f3fe6ac449e5 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:47.227334 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-84279e1d-a246-470f-9c03-f3fe6ac449e5 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] [instance: eb175839-504d-4d07-b576-d51202b9ccae] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:47.228933 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-a49f136f-8388-4e10-80ec-311a70ec8741 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: e7deeb40-9fc3-40f8-b564-192fe68fa113] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:47.234989 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-84279e1d-a246-470f-9c03-f3fe6ac449e5 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:47.235540 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-84279e1d-a246-470f-9c03-f3fe6ac449e5 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:47.236246 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-a49f136f-8388-4e10-80ec-311a70ec8741 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:47.236759 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-84279e1d-a246-470f-9c03-f3fe6ac449e5 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:47.236919 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-a49f136f-8388-4e10-80ec-311a70ec8741 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:47.237321 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-84279e1d-a246-470f-9c03-f3fe6ac449e5 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:47.237862 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-a49f136f-8388-4e10-80ec-311a70ec8741 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:47.241106 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-a49f136f-8388-4e10-80ec-311a70ec8741 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:47.267302 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.objects.instance [None req-a49f136f-8388-4e10-80ec-311a70ec8741 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lazy-loading 'flavor' on Instance uuid e7deeb40-9fc3-40f8-b564-192fe68fa113 {{(pid=129953) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 10:57:47.375932 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG dbcounter [-] [129953] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=129953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:57:47.381046 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-84279e1d-a246-470f-9c03-f3fe6ac449e5 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914de37664914b4cb91e0ce2c3a0e1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66234794284419a47e3afcae968084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:47.389780 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-84279e1d-a246-470f-9c03-f3fe6ac449e5 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] 10.222.0.115 "GET /compute/v2.1/servers/eb175839-504d-4d07-b576-d51202b9ccae" status: 200 len: 1270 microversion: 2.1 time: 0.167353 Aug 02 10:57:47.394184 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 169/340] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:57:47 2022] GET /compute/v2.1/servers/eb175839-504d-4d07-b576-d51202b9ccae => generated 1270 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:57:47.395223 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-7f84c267-90d9-49b4-83c9-9bdcac71e144 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:47.395839 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-7f84c267-90d9-49b4-83c9-9bdcac71e144 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: b3a92fc5-5c44-48d1-8394-535687bb6ae3] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:47.402585 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-7f84c267-90d9-49b4-83c9-9bdcac71e144 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:47.403077 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-7f84c267-90d9-49b4-83c9-9bdcac71e144 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:47.404031 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-7f84c267-90d9-49b4-83c9-9bdcac71e144 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:47.404498 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-7f84c267-90d9-49b4-83c9-9bdcac71e144 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:47.408998 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG dbcounter [-] [129952] Writing DB stats nova_cell1:SELECT=100 {{(pid=129952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:57:47.522537 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-a49f136f-8388-4e10-80ec-311a70ec8741 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "POST /compute/v2.1/servers/e7deeb40-9fc3-40f8-b564-192fe68fa113/action" status: 200 len: 32 microversion: 2.1 time: 0.301358 Aug 02 10:57:47.523469 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 172/341] 10.222.0.115 () {60 vars in 1283 bytes} [Tue Aug 2 10:57:47 2022] POST /compute/v2.1/servers/e7deeb40-9fc3-40f8-b564-192fe68fa113/action => generated 32 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 10:57:47.534347 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-c4644f54-e39d-40bd-a286-f8ae5512a8ff tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:47.535087 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-c4644f54-e39d-40bd-a286-f8ae5512a8ff tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: e7deeb40-9fc3-40f8-b564-192fe68fa113] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:47.541774 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-c4644f54-e39d-40bd-a286-f8ae5512a8ff tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:47.542148 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-7f84c267-90d9-49b4-83c9-9bdcac71e144 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:47.542302 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-c4644f54-e39d-40bd-a286-f8ae5512a8ff tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:47.543015 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-c4644f54-e39d-40bd-a286-f8ae5512a8ff tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:47.544152 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-c4644f54-e39d-40bd-a286-f8ae5512a8ff tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:47.551720 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-7f84c267-90d9-49b4-83c9-9bdcac71e144 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:47.553391 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-7f84c267-90d9-49b4-83c9-9bdcac71e144 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:47.554634 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-7f84c267-90d9-49b4-83c9-9bdcac71e144 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3" status: 200 len: 1813 microversion: 2.20 time: 0.163217 Aug 02 10:57:47.555344 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 170/342] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 10:57:47 2022] GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3 => generated 1813 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:57:47.698159 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-c4644f54-e39d-40bd-a286-f8ae5512a8ff tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:47.706359 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-c4644f54-e39d-40bd-a286-f8ae5512a8ff tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/e7deeb40-9fc3-40f8-b564-192fe68fa113" status: 200 len: 1525 microversion: 2.1 time: 0.176553 Aug 02 10:57:47.707027 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 173/343] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:57:47 2022] GET /compute/v2.1/servers/e7deeb40-9fc3-40f8-b564-192fe68fa113 => generated 1525 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:57:48.410907 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-1ce659e8-122a-4b9e-a762-d95ab57ccf0f tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:48.411544 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-1ce659e8-122a-4b9e-a762-d95ab57ccf0f tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] [instance: eb175839-504d-4d07-b576-d51202b9ccae] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:48.419247 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-1ce659e8-122a-4b9e-a762-d95ab57ccf0f tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:48.420167 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-1ce659e8-122a-4b9e-a762-d95ab57ccf0f tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:48.421273 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-1ce659e8-122a-4b9e-a762-d95ab57ccf0f tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:48.422018 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-1ce659e8-122a-4b9e-a762-d95ab57ccf0f tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:48.564735 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-1ce659e8-122a-4b9e-a762-d95ab57ccf0f tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914de37664914b4cb91e0ce2c3a0e1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66234794284419a47e3afcae968084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:48.572734 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-1ce659e8-122a-4b9e-a762-d95ab57ccf0f tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] 10.222.0.115 "GET /compute/v2.1/servers/eb175839-504d-4d07-b576-d51202b9ccae" status: 200 len: 1457 microversion: 2.1 time: 0.165971 Aug 02 10:57:48.573441 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 171/344] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:57:48 2022] GET /compute/v2.1/servers/eb175839-504d-4d07-b576-d51202b9ccae => generated 1457 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:57:48.578625 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-170f27d4-f32a-4f35-9f10-e98233d47343 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:48.579304 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-170f27d4-f32a-4f35-9f10-e98233d47343 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: b3a92fc5-5c44-48d1-8394-535687bb6ae3] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:48.586839 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-170f27d4-f32a-4f35-9f10-e98233d47343 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:48.587630 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-170f27d4-f32a-4f35-9f10-e98233d47343 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:48.588404 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-170f27d4-f32a-4f35-9f10-e98233d47343 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:48.588834 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-170f27d4-f32a-4f35-9f10-e98233d47343 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:48.596432 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-d53716f8-3ea3-45d3-b68f-f356ce12ea90 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:48.597057 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-d53716f8-3ea3-45d3-b68f-f356ce12ea90 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] [instance: eb175839-504d-4d07-b576-d51202b9ccae] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:48.603852 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-d53716f8-3ea3-45d3-b68f-f356ce12ea90 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:48.604314 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-d53716f8-3ea3-45d3-b68f-f356ce12ea90 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:48.605096 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-d53716f8-3ea3-45d3-b68f-f356ce12ea90 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:48.605532 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-d53716f8-3ea3-45d3-b68f-f356ce12ea90 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:48.865579 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-170f27d4-f32a-4f35-9f10-e98233d47343 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:48.877285 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-d53716f8-3ea3-45d3-b68f-f356ce12ea90 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914de37664914b4cb91e0ce2c3a0e1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66234794284419a47e3afcae968084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:48.885647 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-170f27d4-f32a-4f35-9f10-e98233d47343 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:48.889269 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-d53716f8-3ea3-45d3-b68f-f356ce12ea90 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] 10.222.0.115 "GET /compute/v2.1/servers/eb175839-504d-4d07-b576-d51202b9ccae" status: 200 len: 1457 microversion: 2.1 time: 0.297789 Aug 02 10:57:48.889886 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 172/345] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:57:48 2022] GET /compute/v2.1/servers/eb175839-504d-4d07-b576-d51202b9ccae => generated 1457 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:57:48.894541 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-170f27d4-f32a-4f35-9f10-e98233d47343 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:48.894541 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-170f27d4-f32a-4f35-9f10-e98233d47343 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3" status: 200 len: 1813 microversion: 2.20 time: 0.319022 Aug 02 10:57:48.894541 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 174/346] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 10:57:48 2022] GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3 => generated 1813 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:57:48.907406 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-7d7b8daf-aa46-473b-ad79-c85a801afdd7 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:48.908092 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-7d7b8daf-aa46-473b-ad79-c85a801afdd7 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: e7deeb40-9fc3-40f8-b564-192fe68fa113] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:48.916594 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-7d7b8daf-aa46-473b-ad79-c85a801afdd7 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:48.917207 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-7d7b8daf-aa46-473b-ad79-c85a801afdd7 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:48.919023 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-7d7b8daf-aa46-473b-ad79-c85a801afdd7 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:48.919679 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-7d7b8daf-aa46-473b-ad79-c85a801afdd7 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:49.188682 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-7d7b8daf-aa46-473b-ad79-c85a801afdd7 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:49.197256 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-7d7b8daf-aa46-473b-ad79-c85a801afdd7 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/e7deeb40-9fc3-40f8-b564-192fe68fa113" status: 200 len: 1525 microversion: 2.1 time: 0.302885 Aug 02 10:57:49.199183 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 173/347] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:57:48 2022] GET /compute/v2.1/servers/e7deeb40-9fc3-40f8-b564-192fe68fa113 => generated 1525 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:57:49.922559 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-f5d7e70a-77fa-4cac-8a10-2111c02c7e40 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:49.923448 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-f5d7e70a-77fa-4cac-8a10-2111c02c7e40 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: b3a92fc5-5c44-48d1-8394-535687bb6ae3] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:49.930730 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-f5d7e70a-77fa-4cac-8a10-2111c02c7e40 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:49.931584 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-f5d7e70a-77fa-4cac-8a10-2111c02c7e40 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:49.932686 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-f5d7e70a-77fa-4cac-8a10-2111c02c7e40 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:49.933337 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-f5d7e70a-77fa-4cac-8a10-2111c02c7e40 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:50.222183 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-f5d7e70a-77fa-4cac-8a10-2111c02c7e40 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:50.222790 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-69d7491e-b770-4a71-a4f3-cf7a9dfc50b6 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:50.223932 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-69d7491e-b770-4a71-a4f3-cf7a9dfc50b6 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: e7deeb40-9fc3-40f8-b564-192fe68fa113] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:50.230837 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-69d7491e-b770-4a71-a4f3-cf7a9dfc50b6 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:50.231809 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-69d7491e-b770-4a71-a4f3-cf7a9dfc50b6 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:50.232651 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-69d7491e-b770-4a71-a4f3-cf7a9dfc50b6 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:50.233419 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-69d7491e-b770-4a71-a4f3-cf7a9dfc50b6 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:50.235111 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-f5d7e70a-77fa-4cac-8a10-2111c02c7e40 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:50.241011 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-f5d7e70a-77fa-4cac-8a10-2111c02c7e40 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:50.242227 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-f5d7e70a-77fa-4cac-8a10-2111c02c7e40 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3" status: 200 len: 1813 microversion: 2.20 time: 0.326815 Aug 02 10:57:50.243145 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 175/348] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 10:57:49 2022] GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3 => generated 1813 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:57:50.471067 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-69d7491e-b770-4a71-a4f3-cf7a9dfc50b6 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:50.480042 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-69d7491e-b770-4a71-a4f3-cf7a9dfc50b6 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/e7deeb40-9fc3-40f8-b564-192fe68fa113" status: 200 len: 1525 microversion: 2.1 time: 0.264366 Aug 02 10:57:50.498904 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 174/349] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:57:50 2022] GET /compute/v2.1/servers/e7deeb40-9fc3-40f8-b564-192fe68fa113 => generated 1525 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:57:51.271478 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-a1af619a-0a74-4942-a1f9-e4fde1aa7ebf tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:51.273624 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-a1af619a-0a74-4942-a1f9-e4fde1aa7ebf tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: b3a92fc5-5c44-48d1-8394-535687bb6ae3] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:51.283275 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG dbcounter [-] [129953] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=129953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:57:51.283275 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-a1af619a-0a74-4942-a1f9-e4fde1aa7ebf tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:51.283275 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-a1af619a-0a74-4942-a1f9-e4fde1aa7ebf tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:51.285214 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-a1af619a-0a74-4942-a1f9-e4fde1aa7ebf tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:51.285214 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-a1af619a-0a74-4942-a1f9-e4fde1aa7ebf tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:51.466506 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-a1af619a-0a74-4942-a1f9-e4fde1aa7ebf tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:51.470931 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-a1af619a-0a74-4942-a1f9-e4fde1aa7ebf tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:51.472701 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-a1af619a-0a74-4942-a1f9-e4fde1aa7ebf tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:51.474037 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-a1af619a-0a74-4942-a1f9-e4fde1aa7ebf tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3" status: 200 len: 1813 microversion: 2.20 time: 0.207478 Aug 02 10:57:51.474797 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 176/350] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 10:57:51 2022] GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3 => generated 1813 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:57:51.506086 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-dd30bac8-920a-410b-8803-824b2912b34f tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:51.507912 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-dd30bac8-920a-410b-8803-824b2912b34f tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: e7deeb40-9fc3-40f8-b564-192fe68fa113] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:51.518177 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-dd30bac8-920a-410b-8803-824b2912b34f tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:51.528916 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-dd30bac8-920a-410b-8803-824b2912b34f tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:51.529796 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-dd30bac8-920a-410b-8803-824b2912b34f tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:51.530251 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-dd30bac8-920a-410b-8803-824b2912b34f tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:51.745307 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-dd30bac8-920a-410b-8803-824b2912b34f tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:51.754841 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-dd30bac8-920a-410b-8803-824b2912b34f tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/e7deeb40-9fc3-40f8-b564-192fe68fa113" status: 200 len: 1525 microversion: 2.1 time: 0.252474 Aug 02 10:57:51.755669 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 175/351] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:57:51 2022] GET /compute/v2.1/servers/e7deeb40-9fc3-40f8-b564-192fe68fa113 => generated 1525 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:57:51.884132 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [req-34c634e7-ea41-487f-af23-406a79eb5d53 req-d53af0be-7a31-4a6c-89bb-dc9d3335517a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb175839-504d-4d07-b576-d51202b9ccae", "tag": "801aec18-99a3-40f4-959b-068036dc0994"}]} {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:57:51.913818 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [req-34c634e7-ea41-487f-af23-406a79eb5d53 req-d53af0be-7a31-4a6c-89bb-dc9d3335517a service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:51.914257 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [req-34c634e7-ea41-487f-af23-406a79eb5d53 req-d53af0be-7a31-4a6c-89bb-dc9d3335517a service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:51.926215 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.compute.server_external_events [req-34c634e7-ea41-487f-af23-406a79eb5d53 req-d53af0be-7a31-4a6c-89bb-dc9d3335517a service nova] Creating event network-changed:801aec18-99a3-40f4-959b-068036dc0994 for instance eb175839-504d-4d07-b576-d51202b9ccae on hv-cinder-85031 Aug 02 10:57:51.931406 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [req-34c634e7-ea41-487f-af23-406a79eb5d53 req-d53af0be-7a31-4a6c-89bb-dc9d3335517a service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058380 Aug 02 10:57:51.932020 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 177/352] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Aug 2 10:57:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:57:52.306913 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-0c46a352-28bd-4023-859d-c980fc1a04dc tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1196171502", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-2083744582", "security_groups": [{"name": "tempest-secgroup-smoke-1461538415"}], "networks": [{"uuid": "6807892b-a6b9-40cd-9630-681ecba72d32"}], "block_device_mapping_v2": [{"uuid": "a180696c-830c-4678-8f31-57a8b0aecbb0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:57:52.506839 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-a48a1119-0e15-42fc-9adc-6622b456bb17 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:52.510847 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-a48a1119-0e15-42fc-9adc-6622b456bb17 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: b3a92fc5-5c44-48d1-8394-535687bb6ae3] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:52.514604 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.network.neutron [None req-0c46a352-28bd-4023-859d-c980fc1a04dc tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] validate_networks() for [('6807892b-a6b9-40cd-9630-681ecba72d32', None, None, None, None, None)] {{(pid=129952) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 10:57:52.537462 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-a48a1119-0e15-42fc-9adc-6622b456bb17 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:52.545074 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-a48a1119-0e15-42fc-9adc-6622b456bb17 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:52.545074 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-a48a1119-0e15-42fc-9adc-6622b456bb17 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:52.545074 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-a48a1119-0e15-42fc-9adc-6622b456bb17 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:53.054698 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-a48a1119-0e15-42fc-9adc-6622b456bb17 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:53.064171 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-a48a1119-0e15-42fc-9adc-6622b456bb17 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:53.066081 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-a48a1119-0e15-42fc-9adc-6622b456bb17 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:53.084710 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-a48a1119-0e15-42fc-9adc-6622b456bb17 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3" status: 200 len: 1813 microversion: 2.20 time: 0.571995 Aug 02 10:57:53.088071 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 178/353] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 10:57:52 2022] GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3 => generated 1813 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:57:53.104271 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-8ebe0c29-18e7-422f-8251-3f3399e9c6be tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:53.105018 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-8ebe0c29-18e7-422f-8251-3f3399e9c6be tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: e7deeb40-9fc3-40f8-b564-192fe68fa113] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:53.111571 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-8ebe0c29-18e7-422f-8251-3f3399e9c6be tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:53.112025 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-8ebe0c29-18e7-422f-8251-3f3399e9c6be tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:53.124232 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-8ebe0c29-18e7-422f-8251-3f3399e9c6be tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:53.124944 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-8ebe0c29-18e7-422f-8251-3f3399e9c6be tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:53.287776 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.virt.hardware [None req-0c46a352-28bd-4023-859d-c980fc1a04dc tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Flavor limits 0:0:0 {{(pid=129952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 10:57:53.292937 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.virt.hardware [None req-0c46a352-28bd-4023-859d-c980fc1a04dc tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Image limits 0:0:0 {{(pid=129952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 10:57:53.292937 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.virt.hardware [None req-0c46a352-28bd-4023-859d-c980fc1a04dc tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Flavor pref 0:0:0 {{(pid=129952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 10:57:53.292937 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.virt.hardware [None req-0c46a352-28bd-4023-859d-c980fc1a04dc tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Image pref 0:0:0 {{(pid=129952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 10:57:53.292937 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.virt.hardware [None req-0c46a352-28bd-4023-859d-c980fc1a04dc tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 10:57:53.305673 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-0c46a352-28bd-4023-859d-c980fc1a04dc tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:53.306557 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-0c46a352-28bd-4023-859d-c980fc1a04dc tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:53.311083 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-0c46a352-28bd-4023-859d-c980fc1a04dc tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:53.311885 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-0c46a352-28bd-4023-859d-c980fc1a04dc tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:53.351538 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.quota [None req-0c46a352-28bd-4023-859d-c980fc1a04dc tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Getting quotas for project cd54719e5f2b41e6a875361a9188d49b. Resources: {'instances', 'cores', 'ram'} {{(pid=129952) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 10:57:53.368244 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.quota [None req-0c46a352-28bd-4023-859d-c980fc1a04dc tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Getting quotas for user 2664b70cbc1a41a59f78b0b7d4e86643 and project cd54719e5f2b41e6a875361a9188d49b. Resources: {'instances', 'cores', 'ram'} {{(pid=129952) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 10:57:53.473227 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-0c46a352-28bd-4023-859d-c980fc1a04dc tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Going to run 1 instances... {{(pid=129952) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 10:57:53.475625 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-0c46a352-28bd-4023-859d-c980fc1a04dc tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] [instance: 254a6894-dcb1-4909-a24e-a3a9bf701a83] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a180696c-830c-4678-8f31-57a8b0aecbb0',volume_size=None,volume_type=None)] {{(pid=129952) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 10:57:53.757191 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-8ebe0c29-18e7-422f-8251-3f3399e9c6be tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:53.781793 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-8ebe0c29-18e7-422f-8251-3f3399e9c6be tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/e7deeb40-9fc3-40f8-b564-192fe68fa113" status: 200 len: 1525 microversion: 2.1 time: 0.692065 Aug 02 10:57:53.783939 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 179/354] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:57:53 2022] GET /compute/v2.1/servers/e7deeb40-9fc3-40f8-b564-192fe68fa113 => generated 1525 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:57:53.979335 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-0c46a352-28bd-4023-859d-c980fc1a04dc tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] 10.222.0.115 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.676410 Aug 02 10:57:53.980322 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 176/355] 10.222.0.115 () {60 vars in 1152 bytes} [Tue Aug 2 10:57:52 2022] POST /compute/v2.1/servers => generated 408 bytes in 1678 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 02 10:57:53.991492 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-c18b8a40-5703-45a6-9d42-a2ed81945a5b tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:53.992414 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-c18b8a40-5703-45a6-9d42-a2ed81945a5b tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] [instance: 254a6894-dcb1-4909-a24e-a3a9bf701a83] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:54.055730 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-c18b8a40-5703-45a6-9d42-a2ed81945a5b tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2664b70cbc1a41a59f78b0b7d4e86643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd54719e5f2b41e6a875361a9188d49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:54.063847 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-c18b8a40-5703-45a6-9d42-a2ed81945a5b tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] 10.222.0.115 "GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83" status: 200 len: 1092 microversion: 2.1 time: 0.076579 Aug 02 10:57:54.064444 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 180/356] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:57:53 2022] GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83 => generated 1092 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:57:54.120084 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-26e634b5-2577-4879-9325-4927a72c5c26 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:54.120659 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-26e634b5-2577-4879-9325-4927a72c5c26 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: b3a92fc5-5c44-48d1-8394-535687bb6ae3] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:54.123838 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG dbcounter [-] [129952] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=129952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:57:54.134499 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-26e634b5-2577-4879-9325-4927a72c5c26 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:54.134960 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-26e634b5-2577-4879-9325-4927a72c5c26 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:54.135794 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-26e634b5-2577-4879-9325-4927a72c5c26 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:54.136233 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-26e634b5-2577-4879-9325-4927a72c5c26 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:54.332083 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-26e634b5-2577-4879-9325-4927a72c5c26 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:54.341256 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-26e634b5-2577-4879-9325-4927a72c5c26 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:54.342783 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-26e634b5-2577-4879-9325-4927a72c5c26 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:54.344026 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-26e634b5-2577-4879-9325-4927a72c5c26 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3" status: 200 len: 1813 microversion: 2.20 time: 0.228181 Aug 02 10:57:54.362820 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 177/357] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 10:57:54 2022] GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3 => generated 1813 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:57:54.806437 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-f00eb8a6-6ce3-49c6-9f48-f109e919d2bc tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:54.807291 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-f00eb8a6-6ce3-49c6-9f48-f109e919d2bc tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: e7deeb40-9fc3-40f8-b564-192fe68fa113] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:54.814530 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-f00eb8a6-6ce3-49c6-9f48-f109e919d2bc tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:54.816081 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-f00eb8a6-6ce3-49c6-9f48-f109e919d2bc tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:54.816081 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-f00eb8a6-6ce3-49c6-9f48-f109e919d2bc tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:54.816454 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-f00eb8a6-6ce3-49c6-9f48-f109e919d2bc tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:55.022034 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-f00eb8a6-6ce3-49c6-9f48-f109e919d2bc tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:55.030868 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-f00eb8a6-6ce3-49c6-9f48-f109e919d2bc tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/e7deeb40-9fc3-40f8-b564-192fe68fa113" status: 200 len: 1525 microversion: 2.1 time: 0.228355 Aug 02 10:57:55.031728 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 181/358] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:57:54 2022] GET /compute/v2.1/servers/e7deeb40-9fc3-40f8-b564-192fe68fa113 => generated 1525 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:57:55.085688 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-2bb653b0-6ce6-44e6-b1f3-135fdcc734ea tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:55.088617 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-2bb653b0-6ce6-44e6-b1f3-135fdcc734ea tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] [instance: 254a6894-dcb1-4909-a24e-a3a9bf701a83] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:55.093461 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-2bb653b0-6ce6-44e6-b1f3-135fdcc734ea tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:55.094150 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-2bb653b0-6ce6-44e6-b1f3-135fdcc734ea tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:55.095137 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-2bb653b0-6ce6-44e6-b1f3-135fdcc734ea tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:55.095729 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-2bb653b0-6ce6-44e6-b1f3-135fdcc734ea tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:55.184858 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-2bb653b0-6ce6-44e6-b1f3-135fdcc734ea tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2664b70cbc1a41a59f78b0b7d4e86643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd54719e5f2b41e6a875361a9188d49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:55.194409 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-2bb653b0-6ce6-44e6-b1f3-135fdcc734ea tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] 10.222.0.115 "GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83" status: 200 len: 1142 microversion: 2.1 time: 0.112634 Aug 02 10:57:55.195140 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 178/359] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:57:55 2022] GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83 => generated 1142 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:57:55.368830 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-fa0fa4cc-e6ce-4123-9273-1be66fc01e7b tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:55.369983 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-fa0fa4cc-e6ce-4123-9273-1be66fc01e7b tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: b3a92fc5-5c44-48d1-8394-535687bb6ae3] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:55.380326 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-fa0fa4cc-e6ce-4123-9273-1be66fc01e7b tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:55.382607 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-fa0fa4cc-e6ce-4123-9273-1be66fc01e7b tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:55.383821 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-fa0fa4cc-e6ce-4123-9273-1be66fc01e7b tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:55.384255 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-fa0fa4cc-e6ce-4123-9273-1be66fc01e7b tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:55.549524 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-fa0fa4cc-e6ce-4123-9273-1be66fc01e7b tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:55.562446 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-fa0fa4cc-e6ce-4123-9273-1be66fc01e7b tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:55.567033 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-fa0fa4cc-e6ce-4123-9273-1be66fc01e7b tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:55.567033 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-fa0fa4cc-e6ce-4123-9273-1be66fc01e7b tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3" status: 200 len: 1813 microversion: 2.20 time: 0.201334 Aug 02 10:57:55.567033 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 182/360] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 10:57:55 2022] GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3 => generated 1813 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:57:56.052954 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-41761b1c-d6c1-4ccc-8157-ac5d2b7b09e9 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:56.053833 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-41761b1c-d6c1-4ccc-8157-ac5d2b7b09e9 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: e7deeb40-9fc3-40f8-b564-192fe68fa113] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:56.060537 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-41761b1c-d6c1-4ccc-8157-ac5d2b7b09e9 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:56.061111 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-41761b1c-d6c1-4ccc-8157-ac5d2b7b09e9 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:56.061877 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-41761b1c-d6c1-4ccc-8157-ac5d2b7b09e9 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:56.062309 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-41761b1c-d6c1-4ccc-8157-ac5d2b7b09e9 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:56.200995 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-41761b1c-d6c1-4ccc-8157-ac5d2b7b09e9 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:56.208806 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-41761b1c-d6c1-4ccc-8157-ac5d2b7b09e9 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/e7deeb40-9fc3-40f8-b564-192fe68fa113" status: 200 len: 1525 microversion: 2.1 time: 0.159733 Aug 02 10:57:56.209377 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 179/361] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:57:56 2022] GET /compute/v2.1/servers/e7deeb40-9fc3-40f8-b564-192fe68fa113 => generated 1525 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:57:56.223609 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-b80c01f6-72dd-423e-ac17-a12101935acc tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:56.224312 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-b80c01f6-72dd-423e-ac17-a12101935acc tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] [instance: 254a6894-dcb1-4909-a24e-a3a9bf701a83] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:56.230559 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-b80c01f6-72dd-423e-ac17-a12101935acc tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:56.231022 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-b80c01f6-72dd-423e-ac17-a12101935acc tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:56.231840 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-b80c01f6-72dd-423e-ac17-a12101935acc tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:56.232278 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-b80c01f6-72dd-423e-ac17-a12101935acc tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:56.300124 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-b80c01f6-72dd-423e-ac17-a12101935acc tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2664b70cbc1a41a59f78b0b7d4e86643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd54719e5f2b41e6a875361a9188d49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:56.308124 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-b80c01f6-72dd-423e-ac17-a12101935acc tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] 10.222.0.115 "GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83" status: 200 len: 1142 microversion: 2.1 time: 0.088766 Aug 02 10:57:56.309905 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 183/362] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:57:56 2022] GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83 => generated 1142 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:57:56.592424 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-acc94ed0-1c9a-4147-b613-76052f2aa8f8 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:56.592954 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-acc94ed0-1c9a-4147-b613-76052f2aa8f8 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: b3a92fc5-5c44-48d1-8394-535687bb6ae3] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:56.599281 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-acc94ed0-1c9a-4147-b613-76052f2aa8f8 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:56.599730 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-acc94ed0-1c9a-4147-b613-76052f2aa8f8 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:56.600586 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-acc94ed0-1c9a-4147-b613-76052f2aa8f8 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:56.601049 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-acc94ed0-1c9a-4147-b613-76052f2aa8f8 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:56.775231 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-acc94ed0-1c9a-4147-b613-76052f2aa8f8 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:56.785326 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-acc94ed0-1c9a-4147-b613-76052f2aa8f8 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:56.786840 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-acc94ed0-1c9a-4147-b613-76052f2aa8f8 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:56.788062 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-acc94ed0-1c9a-4147-b613-76052f2aa8f8 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3" status: 200 len: 1813 microversion: 2.20 time: 0.202732 Aug 02 10:57:56.788610 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 180/363] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 10:57:56 2022] GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3 => generated 1813 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:57:57.229698 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-af6a1333-5709-415c-b0f9-63a11ac8e5f4 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:57.230334 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-af6a1333-5709-415c-b0f9-63a11ac8e5f4 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: e7deeb40-9fc3-40f8-b564-192fe68fa113] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:57.237433 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-af6a1333-5709-415c-b0f9-63a11ac8e5f4 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:57.237877 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-af6a1333-5709-415c-b0f9-63a11ac8e5f4 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:57.238644 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-af6a1333-5709-415c-b0f9-63a11ac8e5f4 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:57.239110 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-af6a1333-5709-415c-b0f9-63a11ac8e5f4 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:57.331076 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-ea2251e0-ebbb-42af-a6d5-890e5db1ba3a tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:57.332307 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-ea2251e0-ebbb-42af-a6d5-890e5db1ba3a tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] [instance: 254a6894-dcb1-4909-a24e-a3a9bf701a83] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:57.339182 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-ea2251e0-ebbb-42af-a6d5-890e5db1ba3a tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:57.339898 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-ea2251e0-ebbb-42af-a6d5-890e5db1ba3a tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:57.340837 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-ea2251e0-ebbb-42af-a6d5-890e5db1ba3a tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:57.341432 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-ea2251e0-ebbb-42af-a6d5-890e5db1ba3a tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:57.404276 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-af6a1333-5709-415c-b0f9-63a11ac8e5f4 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:57.412933 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-af6a1333-5709-415c-b0f9-63a11ac8e5f4 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/e7deeb40-9fc3-40f8-b564-192fe68fa113" status: 200 len: 1525 microversion: 2.1 time: 0.187010 Aug 02 10:57:57.413592 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 184/364] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:57:57 2022] GET /compute/v2.1/servers/e7deeb40-9fc3-40f8-b564-192fe68fa113 => generated 1525 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:57:57.420348 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-ea2251e0-ebbb-42af-a6d5-890e5db1ba3a tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2664b70cbc1a41a59f78b0b7d4e86643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd54719e5f2b41e6a875361a9188d49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:57.428058 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-ea2251e0-ebbb-42af-a6d5-890e5db1ba3a tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] 10.222.0.115 "GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83" status: 200 len: 1142 microversion: 2.1 time: 0.100853 Aug 02 10:57:57.428618 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 181/365] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:57:57 2022] GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83 => generated 1142 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:57:57.817055 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-ee83a143-cbb9-4aa1-9b15-1a0f7d1a0987 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:57.817652 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-ee83a143-cbb9-4aa1-9b15-1a0f7d1a0987 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: b3a92fc5-5c44-48d1-8394-535687bb6ae3] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:57.823703 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-ee83a143-cbb9-4aa1-9b15-1a0f7d1a0987 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:57.824145 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-ee83a143-cbb9-4aa1-9b15-1a0f7d1a0987 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:57.825281 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-ee83a143-cbb9-4aa1-9b15-1a0f7d1a0987 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:57.825716 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-ee83a143-cbb9-4aa1-9b15-1a0f7d1a0987 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:57.970190 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-ee83a143-cbb9-4aa1-9b15-1a0f7d1a0987 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:57.979198 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-ee83a143-cbb9-4aa1-9b15-1a0f7d1a0987 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:57.981327 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-ee83a143-cbb9-4aa1-9b15-1a0f7d1a0987 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:57.982510 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-ee83a143-cbb9-4aa1-9b15-1a0f7d1a0987 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3" status: 200 len: 1813 microversion: 2.20 time: 0.169355 Aug 02 10:57:57.983396 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 185/366] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 10:57:57 2022] GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3 => generated 1813 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:57:58.433420 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-9a967357-d01f-4428-8d3a-72105564411b tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:58.434255 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-9a967357-d01f-4428-8d3a-72105564411b tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: e7deeb40-9fc3-40f8-b564-192fe68fa113] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:58.440961 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-9a967357-d01f-4428-8d3a-72105564411b tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:58.441407 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-9a967357-d01f-4428-8d3a-72105564411b tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:58.442318 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-9a967357-d01f-4428-8d3a-72105564411b tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:58.442834 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-9a967357-d01f-4428-8d3a-72105564411b tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:58.450252 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-027e67c8-a228-4953-b490-e108be700c17 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:58.451103 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-027e67c8-a228-4953-b490-e108be700c17 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] [instance: 254a6894-dcb1-4909-a24e-a3a9bf701a83] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:58.457775 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-027e67c8-a228-4953-b490-e108be700c17 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:58.458212 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-027e67c8-a228-4953-b490-e108be700c17 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:58.459525 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-027e67c8-a228-4953-b490-e108be700c17 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:58.459525 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-027e67c8-a228-4953-b490-e108be700c17 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:58.543323 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-027e67c8-a228-4953-b490-e108be700c17 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2664b70cbc1a41a59f78b0b7d4e86643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd54719e5f2b41e6a875361a9188d49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:58.550925 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-027e67c8-a228-4953-b490-e108be700c17 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] 10.222.0.115 "GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83" status: 200 len: 1142 microversion: 2.1 time: 0.105212 Aug 02 10:57:58.551759 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 186/367] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:57:58 2022] GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83 => generated 1142 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:57:58.601333 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-9a967357-d01f-4428-8d3a-72105564411b tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:58.608922 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-9a967357-d01f-4428-8d3a-72105564411b tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/e7deeb40-9fc3-40f8-b564-192fe68fa113" status: 200 len: 1525 microversion: 2.1 time: 0.179498 Aug 02 10:57:58.611162 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 182/368] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:57:58 2022] GET /compute/v2.1/servers/e7deeb40-9fc3-40f8-b564-192fe68fa113 => generated 1525 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:57:59.007281 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-696e5384-03ce-4543-9a86-710c4e960206 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:59.007805 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-696e5384-03ce-4543-9a86-710c4e960206 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: b3a92fc5-5c44-48d1-8394-535687bb6ae3] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:59.014530 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-696e5384-03ce-4543-9a86-710c4e960206 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:59.015007 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-696e5384-03ce-4543-9a86-710c4e960206 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:59.015805 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-696e5384-03ce-4543-9a86-710c4e960206 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:59.016237 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-696e5384-03ce-4543-9a86-710c4e960206 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:59.147075 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-696e5384-03ce-4543-9a86-710c4e960206 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:59.155891 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-696e5384-03ce-4543-9a86-710c4e960206 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:59.157433 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-696e5384-03ce-4543-9a86-710c4e960206 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:59.158890 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-696e5384-03ce-4543-9a86-710c4e960206 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3" status: 200 len: 1813 microversion: 2.20 time: 0.155705 Aug 02 10:57:59.159483 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 187/369] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 10:57:59 2022] GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3 => generated 1813 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:57:59.571730 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-988cf4c0-e38c-4c89-ad82-a2e93e19fb99 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:59.572347 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-988cf4c0-e38c-4c89-ad82-a2e93e19fb99 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] [instance: 254a6894-dcb1-4909-a24e-a3a9bf701a83] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:59.579142 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-988cf4c0-e38c-4c89-ad82-a2e93e19fb99 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:59.579594 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-988cf4c0-e38c-4c89-ad82-a2e93e19fb99 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:59.580349 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-988cf4c0-e38c-4c89-ad82-a2e93e19fb99 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:59.580783 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-988cf4c0-e38c-4c89-ad82-a2e93e19fb99 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:59.630095 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-7ff20bab-3e2a-4754-81c4-4f8f2f71e975 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:57:59.630667 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-7ff20bab-3e2a-4754-81c4-4f8f2f71e975 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: e7deeb40-9fc3-40f8-b564-192fe68fa113] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:57:59.637468 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-7ff20bab-3e2a-4754-81c4-4f8f2f71e975 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:59.637913 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-7ff20bab-3e2a-4754-81c4-4f8f2f71e975 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:59.638688 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-7ff20bab-3e2a-4754-81c4-4f8f2f71e975 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:57:59.639154 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-7ff20bab-3e2a-4754-81c4-4f8f2f71e975 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:57:59.648025 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-988cf4c0-e38c-4c89-ad82-a2e93e19fb99 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2664b70cbc1a41a59f78b0b7d4e86643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd54719e5f2b41e6a875361a9188d49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:59.656539 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-988cf4c0-e38c-4c89-ad82-a2e93e19fb99 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] 10.222.0.115 "GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83" status: 200 len: 1134 microversion: 2.1 time: 0.088766 Aug 02 10:57:59.657131 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 183/370] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:57:59 2022] GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83 => generated 1134 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:57:59.771784 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-7ff20bab-3e2a-4754-81c4-4f8f2f71e975 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:57:59.779999 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-7ff20bab-3e2a-4754-81c4-4f8f2f71e975 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/e7deeb40-9fc3-40f8-b564-192fe68fa113" status: 200 len: 1525 microversion: 2.1 time: 0.154296 Aug 02 10:57:59.780565 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 188/371] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:57:59 2022] GET /compute/v2.1/servers/e7deeb40-9fc3-40f8-b564-192fe68fa113 => generated 1525 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:58:00.185025 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-a7d81f0c-a774-466a-b056-92f1e470c28a tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:00.185515 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-a7d81f0c-a774-466a-b056-92f1e470c28a tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: b3a92fc5-5c44-48d1-8394-535687bb6ae3] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:00.191722 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-a7d81f0c-a774-466a-b056-92f1e470c28a tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:00.192167 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-a7d81f0c-a774-466a-b056-92f1e470c28a tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:00.192953 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-a7d81f0c-a774-466a-b056-92f1e470c28a tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:00.193385 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-a7d81f0c-a774-466a-b056-92f1e470c28a tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:00.327601 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-a7d81f0c-a774-466a-b056-92f1e470c28a tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:00.336220 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-a7d81f0c-a774-466a-b056-92f1e470c28a tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:00.337804 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-a7d81f0c-a774-466a-b056-92f1e470c28a tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:00.338961 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-a7d81f0c-a774-466a-b056-92f1e470c28a tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3" status: 200 len: 1813 microversion: 2.20 time: 0.158674 Aug 02 10:58:00.339565 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 184/372] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 10:58:00 2022] GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3 => generated 1813 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:58:00.677802 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-738591bf-5dba-41d2-ab0a-84fdd0f9d75f tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:00.678430 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-738591bf-5dba-41d2-ab0a-84fdd0f9d75f tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] [instance: 254a6894-dcb1-4909-a24e-a3a9bf701a83] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:00.685585 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-738591bf-5dba-41d2-ab0a-84fdd0f9d75f tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:00.686032 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-738591bf-5dba-41d2-ab0a-84fdd0f9d75f tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:00.686790 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-738591bf-5dba-41d2-ab0a-84fdd0f9d75f tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:00.687266 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-738591bf-5dba-41d2-ab0a-84fdd0f9d75f tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:00.749928 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-738591bf-5dba-41d2-ab0a-84fdd0f9d75f tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2664b70cbc1a41a59f78b0b7d4e86643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd54719e5f2b41e6a875361a9188d49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:00.757564 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-738591bf-5dba-41d2-ab0a-84fdd0f9d75f tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] 10.222.0.115 "GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83" status: 200 len: 1134 microversion: 2.1 time: 0.083621 Aug 02 10:58:00.758131 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 189/373] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:58:00 2022] GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83 => generated 1134 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:58:00.801088 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-3d43a382-64d1-461e-925d-75e4177949bf tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:00.801703 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-3d43a382-64d1-461e-925d-75e4177949bf tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: e7deeb40-9fc3-40f8-b564-192fe68fa113] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:00.808251 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-3d43a382-64d1-461e-925d-75e4177949bf tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:00.809352 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-3d43a382-64d1-461e-925d-75e4177949bf tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:00.810122 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-3d43a382-64d1-461e-925d-75e4177949bf tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:00.810555 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-3d43a382-64d1-461e-925d-75e4177949bf tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:00.939236 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-3d43a382-64d1-461e-925d-75e4177949bf tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:00.946666 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-3d43a382-64d1-461e-925d-75e4177949bf tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/e7deeb40-9fc3-40f8-b564-192fe68fa113" status: 200 len: 1525 microversion: 2.1 time: 0.149497 Aug 02 10:58:00.947243 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 185/374] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:58:00 2022] GET /compute/v2.1/servers/e7deeb40-9fc3-40f8-b564-192fe68fa113 => generated 1525 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:58:01.362580 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-cd611c24-e81f-4ef9-a0fb-c3b4c7422a2c tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:01.363212 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-cd611c24-e81f-4ef9-a0fb-c3b4c7422a2c tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: b3a92fc5-5c44-48d1-8394-535687bb6ae3] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:01.369279 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-cd611c24-e81f-4ef9-a0fb-c3b4c7422a2c tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:01.369739 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-cd611c24-e81f-4ef9-a0fb-c3b4c7422a2c tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:01.370488 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-cd611c24-e81f-4ef9-a0fb-c3b4c7422a2c tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:01.370924 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-cd611c24-e81f-4ef9-a0fb-c3b4c7422a2c tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:01.511245 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-cd611c24-e81f-4ef9-a0fb-c3b4c7422a2c tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:01.515640 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG dbcounter [-] [129953] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=129953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:58:01.521061 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-cd611c24-e81f-4ef9-a0fb-c3b4c7422a2c tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:01.522575 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-cd611c24-e81f-4ef9-a0fb-c3b4c7422a2c tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:01.523760 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-cd611c24-e81f-4ef9-a0fb-c3b4c7422a2c tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3" status: 200 len: 1813 microversion: 2.20 time: 0.165166 Aug 02 10:58:01.524485 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 190/375] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 10:58:01 2022] GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3 => generated 1813 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:58:01.778817 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-3a596bc2-51a3-47c8-9d31-86d09ef7f71e tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:01.780730 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-3a596bc2-51a3-47c8-9d31-86d09ef7f71e tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] [instance: 254a6894-dcb1-4909-a24e-a3a9bf701a83] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:01.785863 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-3a596bc2-51a3-47c8-9d31-86d09ef7f71e tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:01.786336 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-3a596bc2-51a3-47c8-9d31-86d09ef7f71e tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:01.787080 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-3a596bc2-51a3-47c8-9d31-86d09ef7f71e tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:01.787508 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-3a596bc2-51a3-47c8-9d31-86d09ef7f71e tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:01.856311 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-3a596bc2-51a3-47c8-9d31-86d09ef7f71e tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2664b70cbc1a41a59f78b0b7d4e86643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd54719e5f2b41e6a875361a9188d49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:01.863937 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-3a596bc2-51a3-47c8-9d31-86d09ef7f71e tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] 10.222.0.115 "GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83" status: 200 len: 1190 microversion: 2.1 time: 0.089501 Aug 02 10:58:01.866772 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 186/376] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:58:01 2022] GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83 => generated 1190 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:58:01.968783 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-e6e26fa9-e71f-4cf8-a1d8-e319aaf16cd6 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:01.969416 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-e6e26fa9-e71f-4cf8-a1d8-e319aaf16cd6 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: e7deeb40-9fc3-40f8-b564-192fe68fa113] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:01.976515 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-e6e26fa9-e71f-4cf8-a1d8-e319aaf16cd6 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:01.976953 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-e6e26fa9-e71f-4cf8-a1d8-e319aaf16cd6 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:01.977705 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-e6e26fa9-e71f-4cf8-a1d8-e319aaf16cd6 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:01.978128 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-e6e26fa9-e71f-4cf8-a1d8-e319aaf16cd6 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:02.119375 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-e6e26fa9-e71f-4cf8-a1d8-e319aaf16cd6 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:02.127766 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-e6e26fa9-e71f-4cf8-a1d8-e319aaf16cd6 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/e7deeb40-9fc3-40f8-b564-192fe68fa113" status: 200 len: 1525 microversion: 2.1 time: 0.163200 Aug 02 10:58:02.128379 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 191/377] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:58:01 2022] GET /compute/v2.1/servers/e7deeb40-9fc3-40f8-b564-192fe68fa113 => generated 1525 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:58:02.551783 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-b6829fcb-c369-4a51-a149-dcf35a23827b tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:02.552106 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-b6829fcb-c369-4a51-a149-dcf35a23827b tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: b3a92fc5-5c44-48d1-8394-535687bb6ae3] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:02.559729 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-b6829fcb-c369-4a51-a149-dcf35a23827b tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:02.560481 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-b6829fcb-c369-4a51-a149-dcf35a23827b tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:02.561684 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-b6829fcb-c369-4a51-a149-dcf35a23827b tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:02.562288 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-b6829fcb-c369-4a51-a149-dcf35a23827b tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:02.594191 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG dbcounter [-] [129952] Writing DB stats nova_cell1:SELECT=100 {{(pid=129952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:58:02.788346 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-b6829fcb-c369-4a51-a149-dcf35a23827b tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:02.798097 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-b6829fcb-c369-4a51-a149-dcf35a23827b tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:02.799707 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-b6829fcb-c369-4a51-a149-dcf35a23827b tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:02.801220 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-b6829fcb-c369-4a51-a149-dcf35a23827b tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3" status: 200 len: 1813 microversion: 2.20 time: 0.254375 Aug 02 10:58:02.810841 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 187/378] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 10:58:02 2022] GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3 => generated 1813 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:58:02.885755 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-42e0719e-fbc0-4e56-8d3e-cd625bb5edb4 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:02.887951 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-42e0719e-fbc0-4e56-8d3e-cd625bb5edb4 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] [instance: 254a6894-dcb1-4909-a24e-a3a9bf701a83] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:02.895507 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-42e0719e-fbc0-4e56-8d3e-cd625bb5edb4 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:02.896165 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-42e0719e-fbc0-4e56-8d3e-cd625bb5edb4 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:02.896944 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-42e0719e-fbc0-4e56-8d3e-cd625bb5edb4 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:02.898039 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-42e0719e-fbc0-4e56-8d3e-cd625bb5edb4 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:02.987946 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-42e0719e-fbc0-4e56-8d3e-cd625bb5edb4 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2664b70cbc1a41a59f78b0b7d4e86643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd54719e5f2b41e6a875361a9188d49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:02.995936 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-42e0719e-fbc0-4e56-8d3e-cd625bb5edb4 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] 10.222.0.115 "GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83" status: 200 len: 1208 microversion: 2.1 time: 0.114094 Aug 02 10:58:02.996661 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 192/379] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:58:02 2022] GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83 => generated 1208 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:58:03.150560 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-3c5ef42c-a53a-442f-b0e5-f964eaad7680 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:03.151143 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-3c5ef42c-a53a-442f-b0e5-f964eaad7680 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: e7deeb40-9fc3-40f8-b564-192fe68fa113] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:03.161782 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-3c5ef42c-a53a-442f-b0e5-f964eaad7680 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:03.162233 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-3c5ef42c-a53a-442f-b0e5-f964eaad7680 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:03.163017 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-3c5ef42c-a53a-442f-b0e5-f964eaad7680 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:03.163507 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-3c5ef42c-a53a-442f-b0e5-f964eaad7680 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:03.331782 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-3c5ef42c-a53a-442f-b0e5-f964eaad7680 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:03.335913 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG dbcounter [-] [129952] Writing DB stats nova_cell0:SELECT=2 {{(pid=129952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:58:03.343639 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-3c5ef42c-a53a-442f-b0e5-f964eaad7680 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/e7deeb40-9fc3-40f8-b564-192fe68fa113" status: 200 len: 1525 microversion: 2.1 time: 0.198021 Aug 02 10:58:03.345513 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 188/380] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:58:03 2022] GET /compute/v2.1/servers/e7deeb40-9fc3-40f8-b564-192fe68fa113 => generated 1525 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:58:03.827147 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-5bf41e79-77d2-42ce-8412-635d38b7431a tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:03.827786 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-5bf41e79-77d2-42ce-8412-635d38b7431a tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: b3a92fc5-5c44-48d1-8394-535687bb6ae3] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:03.833933 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-5bf41e79-77d2-42ce-8412-635d38b7431a tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:03.834531 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-5bf41e79-77d2-42ce-8412-635d38b7431a tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:03.835324 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-5bf41e79-77d2-42ce-8412-635d38b7431a tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:03.835755 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-5bf41e79-77d2-42ce-8412-635d38b7431a tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:03.985868 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-5bf41e79-77d2-42ce-8412-635d38b7431a tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:03.998377 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-5bf41e79-77d2-42ce-8412-635d38b7431a tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:03.999922 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-5bf41e79-77d2-42ce-8412-635d38b7431a tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:04.001701 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-5bf41e79-77d2-42ce-8412-635d38b7431a tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3" status: 200 len: 1813 microversion: 2.20 time: 0.180204 Aug 02 10:58:04.002261 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 193/381] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 10:58:03 2022] GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3 => generated 1813 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:58:04.020803 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-962f2a97-b189-45e2-ad5b-f11e4b857450 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:04.020803 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-962f2a97-b189-45e2-ad5b-f11e4b857450 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] [instance: 254a6894-dcb1-4909-a24e-a3a9bf701a83] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:04.025043 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG dbcounter [-] [129952] Writing DB stats nova_cell0:SELECT=6 {{(pid=129952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:58:04.030765 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-962f2a97-b189-45e2-ad5b-f11e4b857450 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:04.031443 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-962f2a97-b189-45e2-ad5b-f11e4b857450 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:04.032249 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-962f2a97-b189-45e2-ad5b-f11e4b857450 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:04.032692 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-962f2a97-b189-45e2-ad5b-f11e4b857450 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:04.178045 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-962f2a97-b189-45e2-ad5b-f11e4b857450 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2664b70cbc1a41a59f78b0b7d4e86643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd54719e5f2b41e6a875361a9188d49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:04.186397 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-962f2a97-b189-45e2-ad5b-f11e4b857450 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] 10.222.0.115 "GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83" status: 200 len: 1276 microversion: 2.1 time: 0.171522 Aug 02 10:58:04.187219 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 189/382] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:58:04 2022] GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83 => generated 1276 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:58:04.237641 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [req-1e5d518f-e806-4c85-95a2-49d14cc25fdb req-298215e9-ab43-4fc1-acdc-01320865cda4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "254a6894-dcb1-4909-a24e-a3a9bf701a83", "tag": "950f72fe-d9c4-4546-b649-bf02fe995cd8"}]} {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:58:04.242552 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG dbcounter [-] [129953] Writing DB stats nova_cell0:SELECT=2 {{(pid=129953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:58:04.248477 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [req-1e5d518f-e806-4c85-95a2-49d14cc25fdb req-298215e9-ab43-4fc1-acdc-01320865cda4 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:04.248914 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [req-1e5d518f-e806-4c85-95a2-49d14cc25fdb req-298215e9-ab43-4fc1-acdc-01320865cda4 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:04.260232 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.compute.server_external_events [req-1e5d518f-e806-4c85-95a2-49d14cc25fdb req-298215e9-ab43-4fc1-acdc-01320865cda4 service nova] Creating event network-changed:950f72fe-d9c4-4546-b649-bf02fe995cd8 for instance 254a6894-dcb1-4909-a24e-a3a9bf701a83 on hv-cinder-85031 Aug 02 10:58:04.266394 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [req-1e5d518f-e806-4c85-95a2-49d14cc25fdb req-298215e9-ab43-4fc1-acdc-01320865cda4 service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032571 Aug 02 10:58:04.267328 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 194/383] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Aug 2 10:58:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:58:04.364842 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-e1ba6f59-bc64-4eff-9136-2c4a049b589a tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:04.365492 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-e1ba6f59-bc64-4eff-9136-2c4a049b589a tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: e7deeb40-9fc3-40f8-b564-192fe68fa113] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:04.372756 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-e1ba6f59-bc64-4eff-9136-2c4a049b589a tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:04.373201 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-e1ba6f59-bc64-4eff-9136-2c4a049b589a tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:04.373984 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-e1ba6f59-bc64-4eff-9136-2c4a049b589a tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:04.374421 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-e1ba6f59-bc64-4eff-9136-2c4a049b589a tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:04.508810 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-e1ba6f59-bc64-4eff-9136-2c4a049b589a tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:04.516787 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-e1ba6f59-bc64-4eff-9136-2c4a049b589a tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/e7deeb40-9fc3-40f8-b564-192fe68fa113" status: 200 len: 1525 microversion: 2.1 time: 0.155929 Aug 02 10:58:04.517354 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 190/384] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:58:04 2022] GET /compute/v2.1/servers/e7deeb40-9fc3-40f8-b564-192fe68fa113 => generated 1525 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:58:05.039835 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-1453f7b8-d306-4560-9abb-c5dda0d2fbb9 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:05.046626 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-1453f7b8-d306-4560-9abb-c5dda0d2fbb9 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: b3a92fc5-5c44-48d1-8394-535687bb6ae3] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:05.051139 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-1453f7b8-d306-4560-9abb-c5dda0d2fbb9 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:05.051591 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-1453f7b8-d306-4560-9abb-c5dda0d2fbb9 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:05.052363 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-1453f7b8-d306-4560-9abb-c5dda0d2fbb9 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:05.052796 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-1453f7b8-d306-4560-9abb-c5dda0d2fbb9 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:05.200473 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-1453f7b8-d306-4560-9abb-c5dda0d2fbb9 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:05.210696 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-a17b2cc2-92c8-4199-8930-24fabcffdb57 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:05.211985 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-a17b2cc2-92c8-4199-8930-24fabcffdb57 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] [instance: 254a6894-dcb1-4909-a24e-a3a9bf701a83] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:05.218357 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-1453f7b8-d306-4560-9abb-c5dda0d2fbb9 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:05.235205 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-1453f7b8-d306-4560-9abb-c5dda0d2fbb9 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:05.235632 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-a17b2cc2-92c8-4199-8930-24fabcffdb57 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:05.235632 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-a17b2cc2-92c8-4199-8930-24fabcffdb57 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:05.235803 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-1453f7b8-d306-4560-9abb-c5dda0d2fbb9 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3" status: 200 len: 1813 microversion: 2.20 time: 0.190913 Aug 02 10:58:05.235898 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-a17b2cc2-92c8-4199-8930-24fabcffdb57 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:05.235977 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 195/385] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 10:58:05 2022] GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3 => generated 1813 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:58:05.236065 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-a17b2cc2-92c8-4199-8930-24fabcffdb57 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:05.248410 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [req-d8b095bf-e030-4d61-9638-c65d7ccf52d9 req-0ee558e2-58b2-445d-a979-527725497148 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3a92fc5-5c44-48d1-8394-535687bb6ae3", "name": "network-vif-plugged", "status": "completed", "tag": "03045dd7-30b5-4c87-bcb8-828046dbcd75"}]} {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:58:05.258404 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [req-d8b095bf-e030-4d61-9638-c65d7ccf52d9 req-0ee558e2-58b2-445d-a979-527725497148 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:05.258844 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [req-d8b095bf-e030-4d61-9638-c65d7ccf52d9 req-0ee558e2-58b2-445d-a979-527725497148 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:05.270623 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.compute.server_external_events [req-d8b095bf-e030-4d61-9638-c65d7ccf52d9 req-0ee558e2-58b2-445d-a979-527725497148 service nova] Creating event network-vif-plugged:03045dd7-30b5-4c87-bcb8-828046dbcd75 for instance b3a92fc5-5c44-48d1-8394-535687bb6ae3 on hv-cinder-85031 Aug 02 10:58:05.275805 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [req-d8b095bf-e030-4d61-9638-c65d7ccf52d9 req-0ee558e2-58b2-445d-a979-527725497148 service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033886 Aug 02 10:58:05.276411 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 196/386] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Aug 2 10:58:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:58:05.393890 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-a17b2cc2-92c8-4199-8930-24fabcffdb57 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2664b70cbc1a41a59f78b0b7d4e86643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd54719e5f2b41e6a875361a9188d49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:05.401773 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-a17b2cc2-92c8-4199-8930-24fabcffdb57 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] 10.222.0.115 "GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83" status: 200 len: 1264 microversion: 2.1 time: 0.198004 Aug 02 10:58:05.402918 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 191/387] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:58:05 2022] GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83 => generated 1264 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:58:05.538492 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-2cb9394b-f6e3-4a17-a948-854f56128e98 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:05.539215 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-2cb9394b-f6e3-4a17-a948-854f56128e98 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: e7deeb40-9fc3-40f8-b564-192fe68fa113] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:05.546412 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-2cb9394b-f6e3-4a17-a948-854f56128e98 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:05.546864 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-2cb9394b-f6e3-4a17-a948-854f56128e98 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:05.547663 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-2cb9394b-f6e3-4a17-a948-854f56128e98 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:05.548103 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-2cb9394b-f6e3-4a17-a948-854f56128e98 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:05.681261 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-2cb9394b-f6e3-4a17-a948-854f56128e98 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:05.689171 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-2cb9394b-f6e3-4a17-a948-854f56128e98 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/e7deeb40-9fc3-40f8-b564-192fe68fa113" status: 200 len: 1525 microversion: 2.1 time: 0.154889 Aug 02 10:58:05.689744 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 197/388] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:58:05 2022] GET /compute/v2.1/servers/e7deeb40-9fc3-40f8-b564-192fe68fa113 => generated 1525 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:58:06.248922 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-70018e06-0b1d-4c9a-b3d5-5a8f3e2af814 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:06.249559 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-70018e06-0b1d-4c9a-b3d5-5a8f3e2af814 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: b3a92fc5-5c44-48d1-8394-535687bb6ae3] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:06.255823 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-70018e06-0b1d-4c9a-b3d5-5a8f3e2af814 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:06.256413 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-70018e06-0b1d-4c9a-b3d5-5a8f3e2af814 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:06.257037 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-70018e06-0b1d-4c9a-b3d5-5a8f3e2af814 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:06.257467 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-70018e06-0b1d-4c9a-b3d5-5a8f3e2af814 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:06.391942 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-70018e06-0b1d-4c9a-b3d5-5a8f3e2af814 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:06.400389 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-70018e06-0b1d-4c9a-b3d5-5a8f3e2af814 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:06.401895 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-70018e06-0b1d-4c9a-b3d5-5a8f3e2af814 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:06.403145 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-70018e06-0b1d-4c9a-b3d5-5a8f3e2af814 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3" status: 200 len: 1813 microversion: 2.20 time: 0.159085 Aug 02 10:58:06.403704 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 192/389] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 10:58:06 2022] GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3 => generated 1813 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:58:06.423544 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-f667631d-5a5b-47b4-a406-f59d5ebc6a64 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:06.424155 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-f667631d-5a5b-47b4-a406-f59d5ebc6a64 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] [instance: 254a6894-dcb1-4909-a24e-a3a9bf701a83] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:06.430716 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-f667631d-5a5b-47b4-a406-f59d5ebc6a64 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:06.431192 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-f667631d-5a5b-47b4-a406-f59d5ebc6a64 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:06.431986 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-f667631d-5a5b-47b4-a406-f59d5ebc6a64 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:06.432418 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-f667631d-5a5b-47b4-a406-f59d5ebc6a64 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:06.567320 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-f667631d-5a5b-47b4-a406-f59d5ebc6a64 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2664b70cbc1a41a59f78b0b7d4e86643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd54719e5f2b41e6a875361a9188d49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:06.575191 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-f667631d-5a5b-47b4-a406-f59d5ebc6a64 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] 10.222.0.115 "GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83" status: 200 len: 1264 microversion: 2.1 time: 0.155234 Aug 02 10:58:06.575755 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 198/390] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:58:06 2022] GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:58:06.709884 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-37e9c410-21e1-4464-85a3-fa6c30b692cd tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:06.710614 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-37e9c410-21e1-4464-85a3-fa6c30b692cd tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: e7deeb40-9fc3-40f8-b564-192fe68fa113] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:06.717612 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-37e9c410-21e1-4464-85a3-fa6c30b692cd tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:06.718077 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-37e9c410-21e1-4464-85a3-fa6c30b692cd tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:06.718852 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-37e9c410-21e1-4464-85a3-fa6c30b692cd tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:06.719331 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-37e9c410-21e1-4464-85a3-fa6c30b692cd tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:06.883723 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-37e9c410-21e1-4464-85a3-fa6c30b692cd tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:06.891481 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-37e9c410-21e1-4464-85a3-fa6c30b692cd tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/e7deeb40-9fc3-40f8-b564-192fe68fa113" status: 200 len: 1525 microversion: 2.1 time: 0.185474 Aug 02 10:58:06.892062 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 193/391] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:58:06 2022] GET /compute/v2.1/servers/e7deeb40-9fc3-40f8-b564-192fe68fa113 => generated 1525 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:58:07.425860 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-d8e38f5b-0603-4273-bc01-4f9d2f547781 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:07.426470 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-d8e38f5b-0603-4273-bc01-4f9d2f547781 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: b3a92fc5-5c44-48d1-8394-535687bb6ae3] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:07.433192 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-d8e38f5b-0603-4273-bc01-4f9d2f547781 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:07.434209 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-d8e38f5b-0603-4273-bc01-4f9d2f547781 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:07.434989 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-d8e38f5b-0603-4273-bc01-4f9d2f547781 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:07.435453 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-d8e38f5b-0603-4273-bc01-4f9d2f547781 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:07.566321 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-d8e38f5b-0603-4273-bc01-4f9d2f547781 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:07.575143 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-d8e38f5b-0603-4273-bc01-4f9d2f547781 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:07.576666 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-d8e38f5b-0603-4273-bc01-4f9d2f547781 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:07.577832 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-d8e38f5b-0603-4273-bc01-4f9d2f547781 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3" status: 200 len: 1813 microversion: 2.20 time: 0.155945 Aug 02 10:58:07.578376 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 199/392] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 10:58:07 2022] GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3 => generated 1813 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:58:07.596356 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-9ccffc78-804f-4a5d-b8ea-fa5c2b03c50e tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:07.597001 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-9ccffc78-804f-4a5d-b8ea-fa5c2b03c50e tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] [instance: 254a6894-dcb1-4909-a24e-a3a9bf701a83] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:07.606656 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-9ccffc78-804f-4a5d-b8ea-fa5c2b03c50e tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:07.606656 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-9ccffc78-804f-4a5d-b8ea-fa5c2b03c50e tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:07.606656 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-9ccffc78-804f-4a5d-b8ea-fa5c2b03c50e tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:07.606656 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-9ccffc78-804f-4a5d-b8ea-fa5c2b03c50e tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:07.747370 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-9ccffc78-804f-4a5d-b8ea-fa5c2b03c50e tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2664b70cbc1a41a59f78b0b7d4e86643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd54719e5f2b41e6a875361a9188d49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:07.754869 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-9ccffc78-804f-4a5d-b8ea-fa5c2b03c50e tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] 10.222.0.115 "GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83" status: 200 len: 1264 microversion: 2.1 time: 0.162576 Aug 02 10:58:07.755466 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 194/393] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:58:07 2022] GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83 => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:58:07.913163 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-b3f38cbe-040f-47a2-ba17-047e5fb7a373 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:07.913776 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-b3f38cbe-040f-47a2-ba17-047e5fb7a373 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: e7deeb40-9fc3-40f8-b564-192fe68fa113] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:07.920802 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-b3f38cbe-040f-47a2-ba17-047e5fb7a373 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:07.921251 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-b3f38cbe-040f-47a2-ba17-047e5fb7a373 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:07.922013 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-b3f38cbe-040f-47a2-ba17-047e5fb7a373 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:07.922448 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-b3f38cbe-040f-47a2-ba17-047e5fb7a373 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:08.054303 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-b3f38cbe-040f-47a2-ba17-047e5fb7a373 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:08.061813 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-b3f38cbe-040f-47a2-ba17-047e5fb7a373 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/e7deeb40-9fc3-40f8-b564-192fe68fa113" status: 200 len: 1525 microversion: 2.1 time: 0.152495 Aug 02 10:58:08.062449 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 200/394] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:58:07 2022] GET /compute/v2.1/servers/e7deeb40-9fc3-40f8-b564-192fe68fa113 => generated 1525 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:58:08.603609 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-027abb29-5652-44eb-9d33-60c3c4e9bdd6 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:08.607594 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-027abb29-5652-44eb-9d33-60c3c4e9bdd6 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: b3a92fc5-5c44-48d1-8394-535687bb6ae3] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:08.611421 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-027abb29-5652-44eb-9d33-60c3c4e9bdd6 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:08.611861 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-027abb29-5652-44eb-9d33-60c3c4e9bdd6 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:08.612640 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-027abb29-5652-44eb-9d33-60c3c4e9bdd6 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:08.613072 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-027abb29-5652-44eb-9d33-60c3c4e9bdd6 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:08.775986 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-f47f90b1-19cb-404b-aea5-28dd402d31b7 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:08.776594 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-f47f90b1-19cb-404b-aea5-28dd402d31b7 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] [instance: 254a6894-dcb1-4909-a24e-a3a9bf701a83] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:08.781845 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-027abb29-5652-44eb-9d33-60c3c4e9bdd6 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:08.785047 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-f47f90b1-19cb-404b-aea5-28dd402d31b7 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:08.785491 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-f47f90b1-19cb-404b-aea5-28dd402d31b7 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:08.786260 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-f47f90b1-19cb-404b-aea5-28dd402d31b7 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:08.786686 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-f47f90b1-19cb-404b-aea5-28dd402d31b7 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:08.795150 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-027abb29-5652-44eb-9d33-60c3c4e9bdd6 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:08.796839 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-027abb29-5652-44eb-9d33-60c3c4e9bdd6 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:08.798241 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-027abb29-5652-44eb-9d33-60c3c4e9bdd6 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3" status: 200 len: 1813 microversion: 2.20 time: 0.198961 Aug 02 10:58:08.799273 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 195/395] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 10:58:08 2022] GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3 => generated 1813 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:58:08.950408 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-f47f90b1-19cb-404b-aea5-28dd402d31b7 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2664b70cbc1a41a59f78b0b7d4e86643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd54719e5f2b41e6a875361a9188d49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:08.958882 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-f47f90b1-19cb-404b-aea5-28dd402d31b7 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] 10.222.0.115 "GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83" status: 200 len: 1264 microversion: 2.1 time: 0.186708 Aug 02 10:58:08.959492 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 201/396] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:58:08 2022] GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83 => generated 1264 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:58:09.083478 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-19c01eda-dc19-47fb-9314-2474979a6a21 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:09.084037 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-19c01eda-dc19-47fb-9314-2474979a6a21 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: e7deeb40-9fc3-40f8-b564-192fe68fa113] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:09.091152 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-19c01eda-dc19-47fb-9314-2474979a6a21 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:09.091597 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-19c01eda-dc19-47fb-9314-2474979a6a21 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:09.092370 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-19c01eda-dc19-47fb-9314-2474979a6a21 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:09.092824 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-19c01eda-dc19-47fb-9314-2474979a6a21 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:09.234851 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-19c01eda-dc19-47fb-9314-2474979a6a21 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:09.242658 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-19c01eda-dc19-47fb-9314-2474979a6a21 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/e7deeb40-9fc3-40f8-b564-192fe68fa113" status: 200 len: 1525 microversion: 2.1 time: 0.163319 Aug 02 10:58:09.243282 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 196/397] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:58:09 2022] GET /compute/v2.1/servers/e7deeb40-9fc3-40f8-b564-192fe68fa113 => generated 1525 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:58:09.822863 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-de26a748-7eac-4a5c-bcdd-d500e7b1b574 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:09.823602 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-de26a748-7eac-4a5c-bcdd-d500e7b1b574 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: b3a92fc5-5c44-48d1-8394-535687bb6ae3] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:09.830578 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-de26a748-7eac-4a5c-bcdd-d500e7b1b574 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:09.831028 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-de26a748-7eac-4a5c-bcdd-d500e7b1b574 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:09.832031 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-de26a748-7eac-4a5c-bcdd-d500e7b1b574 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:09.832471 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-de26a748-7eac-4a5c-bcdd-d500e7b1b574 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:09.976050 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-de26a748-7eac-4a5c-bcdd-d500e7b1b574 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:09.979799 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-6417baf3-aace-40ed-9964-c157e428ca9e tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:09.981174 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-6417baf3-aace-40ed-9964-c157e428ca9e tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] [instance: 254a6894-dcb1-4909-a24e-a3a9bf701a83] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:09.985737 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-de26a748-7eac-4a5c-bcdd-d500e7b1b574 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:09.987314 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-de26a748-7eac-4a5c-bcdd-d500e7b1b574 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:09.988787 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-de26a748-7eac-4a5c-bcdd-d500e7b1b574 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3" status: 200 len: 1813 microversion: 2.20 time: 0.169721 Aug 02 10:58:09.989632 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 202/398] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 10:58:09 2022] GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3 => generated 1813 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:58:09.992942 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-6417baf3-aace-40ed-9964-c157e428ca9e tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:09.993743 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-6417baf3-aace-40ed-9964-c157e428ca9e tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:09.995214 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-6417baf3-aace-40ed-9964-c157e428ca9e tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:09.996016 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-6417baf3-aace-40ed-9964-c157e428ca9e tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:10.139371 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-6417baf3-aace-40ed-9964-c157e428ca9e tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2664b70cbc1a41a59f78b0b7d4e86643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd54719e5f2b41e6a875361a9188d49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:10.146995 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-6417baf3-aace-40ed-9964-c157e428ca9e tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] 10.222.0.115 "GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83" status: 200 len: 1264 microversion: 2.1 time: 0.171066 Aug 02 10:58:10.147608 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 197/399] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:58:09 2022] GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83 => generated 1264 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:58:10.264099 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-444fd850-1f65-40b0-ac99-5a68706e84ab tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:10.264626 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-444fd850-1f65-40b0-ac99-5a68706e84ab tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: e7deeb40-9fc3-40f8-b564-192fe68fa113] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:10.270748 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-444fd850-1f65-40b0-ac99-5a68706e84ab tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:10.271262 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-444fd850-1f65-40b0-ac99-5a68706e84ab tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:10.272045 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-444fd850-1f65-40b0-ac99-5a68706e84ab tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:10.272483 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-444fd850-1f65-40b0-ac99-5a68706e84ab tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:10.410836 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-444fd850-1f65-40b0-ac99-5a68706e84ab tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:10.418625 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-444fd850-1f65-40b0-ac99-5a68706e84ab tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/e7deeb40-9fc3-40f8-b564-192fe68fa113" status: 200 len: 1525 microversion: 2.1 time: 0.158719 Aug 02 10:58:10.419288 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 203/400] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:58:10 2022] GET /compute/v2.1/servers/e7deeb40-9fc3-40f8-b564-192fe68fa113 => generated 1525 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:58:11.012816 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-6161ee91-a542-4321-8e6e-1916e8e62490 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:11.013456 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-6161ee91-a542-4321-8e6e-1916e8e62490 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: b3a92fc5-5c44-48d1-8394-535687bb6ae3] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:11.020079 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-6161ee91-a542-4321-8e6e-1916e8e62490 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:11.020528 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-6161ee91-a542-4321-8e6e-1916e8e62490 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:11.022008 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-6161ee91-a542-4321-8e6e-1916e8e62490 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:11.022509 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-6161ee91-a542-4321-8e6e-1916e8e62490 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:11.168451 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-6161ee91-a542-4321-8e6e-1916e8e62490 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:11.170247 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-5490ff8d-a0a4-4c2c-86fe-64575c67321d tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:11.170880 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-5490ff8d-a0a4-4c2c-86fe-64575c67321d tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] [instance: 254a6894-dcb1-4909-a24e-a3a9bf701a83] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:11.177314 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-6161ee91-a542-4321-8e6e-1916e8e62490 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:11.177897 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-5490ff8d-a0a4-4c2c-86fe-64575c67321d tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:11.178380 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-5490ff8d-a0a4-4c2c-86fe-64575c67321d tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:11.178957 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-6161ee91-a542-4321-8e6e-1916e8e62490 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:11.179160 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-5490ff8d-a0a4-4c2c-86fe-64575c67321d tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:11.179612 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-5490ff8d-a0a4-4c2c-86fe-64575c67321d tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:11.180008 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-6161ee91-a542-4321-8e6e-1916e8e62490 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3" status: 200 len: 1800 microversion: 2.20 time: 0.171909 Aug 02 10:58:11.180577 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 198/401] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 10:58:11 2022] GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3 => generated 1800 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:58:11.328118 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-5490ff8d-a0a4-4c2c-86fe-64575c67321d tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2664b70cbc1a41a59f78b0b7d4e86643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd54719e5f2b41e6a875361a9188d49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:11.335956 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-5490ff8d-a0a4-4c2c-86fe-64575c67321d tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] 10.222.0.115 "GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83" status: 200 len: 1264 microversion: 2.1 time: 0.170455 Aug 02 10:58:11.336572 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 204/402] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:58:11 2022] GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83 => generated 1264 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:58:11.439913 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-ae0298ef-7f76-4482-ab1f-997cafb500a0 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:11.440610 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-ae0298ef-7f76-4482-ab1f-997cafb500a0 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: e7deeb40-9fc3-40f8-b564-192fe68fa113] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:11.446883 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-ae0298ef-7f76-4482-ab1f-997cafb500a0 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:11.447358 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-ae0298ef-7f76-4482-ab1f-997cafb500a0 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:11.448114 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-ae0298ef-7f76-4482-ab1f-997cafb500a0 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:11.448544 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-ae0298ef-7f76-4482-ab1f-997cafb500a0 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:11.596773 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-ae0298ef-7f76-4482-ab1f-997cafb500a0 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:11.604718 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-ae0298ef-7f76-4482-ab1f-997cafb500a0 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/e7deeb40-9fc3-40f8-b564-192fe68fa113" status: 200 len: 1525 microversion: 2.1 time: 0.168908 Aug 02 10:58:11.605965 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 199/403] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:58:11 2022] GET /compute/v2.1/servers/e7deeb40-9fc3-40f8-b564-192fe68fa113 => generated 1525 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:58:12.356889 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-31923972-a3fb-4d1b-a07d-4b9d27a0f275 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:12.357509 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-31923972-a3fb-4d1b-a07d-4b9d27a0f275 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] [instance: 254a6894-dcb1-4909-a24e-a3a9bf701a83] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:12.364267 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-31923972-a3fb-4d1b-a07d-4b9d27a0f275 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:12.364719 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-31923972-a3fb-4d1b-a07d-4b9d27a0f275 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:12.365490 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-31923972-a3fb-4d1b-a07d-4b9d27a0f275 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:12.365935 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-31923972-a3fb-4d1b-a07d-4b9d27a0f275 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:12.442542 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-f4414068-b542-4404-9c14-98d1bccd49c1 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:12.443300 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-f4414068-b542-4404-9c14-98d1bccd49c1 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: 9a2aa113-3a93-47a7-8b8f-82761ec366e5] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:12.450757 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-f4414068-b542-4404-9c14-98d1bccd49c1 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:12.451303 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-f4414068-b542-4404-9c14-98d1bccd49c1 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:12.452087 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-f4414068-b542-4404-9c14-98d1bccd49c1 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:12.452516 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-f4414068-b542-4404-9c14-98d1bccd49c1 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:12.486314 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-f4414068-b542-4404-9c14-98d1bccd49c1 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "GET /compute/v2.1/servers/9a2aa113-3a93-47a7-8b8f-82761ec366e5/ips" status: 200 len: 150 microversion: 2.1 time: 0.047263 Aug 02 10:58:12.487328 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 200/404] 10.222.0.115 () {58 vars in 1253 bytes} [Tue Aug 2 10:58:12 2022] GET /compute/v2.1/servers/9a2aa113-3a93-47a7-8b8f-82761ec366e5/ips => generated 150 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:58:12.502649 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-4e82126b-6e9c-4835-9d53-e0422a496621 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9de4c0fd-b9a7-40d2-b857-8cc654a6f15a"}} {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:58:12.505848 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-4e82126b-6e9c-4835-9d53-e0422a496621 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: 9a2aa113-3a93-47a7-8b8f-82761ec366e5] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:12.507501 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-31923972-a3fb-4d1b-a07d-4b9d27a0f275 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2664b70cbc1a41a59f78b0b7d4e86643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd54719e5f2b41e6a875361a9188d49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:12.513964 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-4e82126b-6e9c-4835-9d53-e0422a496621 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:12.514420 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-4e82126b-6e9c-4835-9d53-e0422a496621 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:12.515254 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-4e82126b-6e9c-4835-9d53-e0422a496621 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:12.515696 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-4e82126b-6e9c-4835-9d53-e0422a496621 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:12.516117 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-31923972-a3fb-4d1b-a07d-4b9d27a0f275 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] 10.222.0.115 "GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83" status: 200 len: 1264 microversion: 2.1 time: 0.163044 Aug 02 10:58:12.516658 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 205/405] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:58:12 2022] GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83 => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:58:12.597612 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.wsgi [None req-4e82126b-6e9c-4835-9d53-e0422a496621 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] HTTP exception thrown: Invalid volume: volume 9de4c0fd-b9a7-40d2-b857-8cc654a6f15a is already attached to instances: 8a7b8f4c-0c11-406f-bed6-b4fd18e3c304 Aug 02 10:58:12.599423 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-4e82126b-6e9c-4835-9d53-e0422a496621 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Request method failure captured: Aug 02 10:58:12.599423 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: request: POST /compute/v2.1/servers/9a2aa113-3a93-47a7-8b8f-82761ec366e5/os-volume_attachments HTTP/1.1 Aug 02 10:58:12.599423 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Accept: application/json Aug 02 10:58:12.599423 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Accept-Encoding: identity Aug 02 10:58:12.599423 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Connection: close Aug 02 10:58:12.599423 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Content-Length: 74 Aug 02 10:58:12.599423 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Content-Type: application/json Aug 02 10:58:12.599423 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Host: 10.222.0.115 Aug 02 10:58:12.599423 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Openstack-System-Scope: None Aug 02 10:58:12.599423 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: User-Agent: python-urllib3/1.26.10 Aug 02 10:58:12.599423 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Auth-Token: gAAAAABi6QKMm0zWjcrgGxsKGjmUpSACSDsl300OSZbmfbKI8W7YRiqQlsT7G2Yz8bTCtqeY5P5LouAzxFYTu1e6mP7SLmcSkT2w0SAqH9Ev0MtEiqJ7hFJOgCTtlSAmMKZk3KczE4deWY0afZWtzWq9Z6D1UUJ57x6ix6Lv8M0Q8lVdVaQlJYs Aug 02 10:58:12.599423 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Domain-Id: None Aug 02 10:58:12.599423 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Domain-Name: None Aug 02 10:58:12.599423 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Identity-Status: Confirmed Aug 02 10:58:12.599423 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Is-Admin-Project: True Aug 02 10:58:12.599423 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Project-Domain-Id: default Aug 02 10:58:12.599423 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Project-Domain-Name: Default Aug 02 10:58:12.599423 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Project-Id: 89a4a0cf1852449e8bfc59ddb5a902c1 Aug 02 10:58:12.599423 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Project-Name: tempest-AttachVolumeNegativeTest-1965368294 Aug 02 10:58:12.599423 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Role: reader,member Aug 02 10:58:12.599423 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Roles: reader,member Aug 02 10:58:12.600993 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/89a4a0cf1852449e8bfc59ddb5a902c1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2/89a4a0cf1852449e8bfc59ddb5a902c1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/89a4a0cf1852449e8bfc59ddb5a902c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.115:8080", "publicURL": "http://10.222.0.115:8080/v1/AUTH_89a4a0cf1852449e8bfc59ddb5a902c1"}]}] Aug 02 10:58:12.600993 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Tenant: tempest-AttachVolumeNegativeTest-1965368294 Aug 02 10:58:12.600993 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Tenant-Id: 89a4a0cf1852449e8bfc59ddb5a902c1 Aug 02 10:58:12.600993 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1965368294 Aug 02 10:58:12.600993 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User: tempest-AttachVolumeNegativeTest-1965368294-project Aug 02 10:58:12.600993 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User-Domain-Id: default Aug 02 10:58:12.600993 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User-Domain-Name: Default Aug 02 10:58:12.600993 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User-Id: 53bc14ada1564911b2f0a698aef3f333 Aug 02 10:58:12.600993 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User-Name: tempest-AttachVolumeNegativeTest-1965368294-project Aug 02 10:58:12.600993 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Aug 02 10:58:12.600993 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: {"volumeAttachment": {"volumeId": "9de4c0fd-b9a7-40d2-b857-8cc654a6f15a"}} Aug 02 10:58:12.600993 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: method: > Aug 02 10:58:12.601821 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: exception: Invalid volume: volume 9de4c0fd-b9a7-40d2-b857-8cc654a6f15a is already attached to instances: 8a7b8f4c-0c11-406f-bed6-b4fd18e3c304 Aug 02 10:58:12.601821 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: action_args: {'server_id': '9a2aa113-3a93-47a7-8b8f-82761ec366e5', 'body': {'volumeAttachment': {'volumeId': '9de4c0fd-b9a7-40d2-b857-8cc654a6f15a'}}} Aug 02 10:58:12.601821 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:58:12.601821 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:58:12.601821 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 02 10:58:12.601821 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 02 10:58:12.601821 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 02 10:58:12.601821 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 02 10:58:12.601821 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 02 10:58:12.601821 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 02 10:58:12.601821 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 02 10:58:12.601821 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 02 10:58:12.601821 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 02 10:58:12.601821 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 02 10:58:12.601821 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 9de4c0fd-b9a7-40d2-b857-8cc654a6f15a is already attached to instances: 8a7b8f4c-0c11-406f-bed6-b4fd18e3c304 Aug 02 10:58:12.601821 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 10:58:12.601821 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:58:12.601821 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 10:58:12.601821 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:58:12.603017 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:58:12.603017 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:58:12.603017 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:58:12.603017 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:58:12.603017 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:58:12.603017 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:58:12.603017 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 10:58:12.603017 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 10:58:12.603017 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 10:58:12.603017 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 10:58:12.603017 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 10:58:12.603017 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 10:58:12.603017 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 02 10:58:12.603017 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 02 10:58:12.603017 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 9de4c0fd-b9a7-40d2-b857-8cc654a6f15a is already attached to instances: 8a7b8f4c-0c11-406f-bed6-b4fd18e3c304 Aug 02 10:58:12.603017 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 10:58:12.603017 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:58:12.603017 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 10:58:12.603017 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:58:12.603017 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:58:12.604307 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:58:12.604307 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:58:12.604307 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:58:12.604307 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 9de4c0fd-b9a7-40d2-b857-8cc654a6f15a is already attached to instances: 8a7b8f4c-0c11-406f-bed6-b4fd18e3c304 Aug 02 10:58:12.604307 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 10:58:12.604307 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-4e82126b-6e9c-4835-9d53-e0422a496621 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Returning 400 to user: Invalid volume: volume 9de4c0fd-b9a7-40d2-b857-8cc654a6f15a is already attached to instances: 8a7b8f4c-0c11-406f-bed6-b4fd18e3c304 {{(pid=129952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:58:12.604307 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-4e82126b-6e9c-4835-9d53-e0422a496621 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "POST /compute/v2.1/servers/9a2aa113-3a93-47a7-8b8f-82761ec366e5/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.103798 Aug 02 10:58:12.604307 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 201/406] 10.222.0.115 () {60 vars in 1328 bytes} [Tue Aug 2 10:58:12 2022] POST /compute/v2.1/servers/9a2aa113-3a93-47a7-8b8f-82761ec366e5/os-volume_attachments => generated 174 bytes in 106 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 02 10:58:12.612140 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-560e4dfc-6674-4a1c-84d8-33d80024e995 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:12.612140 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-560e4dfc-6674-4a1c-84d8-33d80024e995 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: 9a2aa113-3a93-47a7-8b8f-82761ec366e5] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:12.617524 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-560e4dfc-6674-4a1c-84d8-33d80024e995 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:12.617965 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-560e4dfc-6674-4a1c-84d8-33d80024e995 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:12.618713 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-560e4dfc-6674-4a1c-84d8-33d80024e995 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:12.619284 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-560e4dfc-6674-4a1c-84d8-33d80024e995 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:12.629700 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-16c2b03e-55c0-43a3-bde9-4c5d2d67c89a tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:12.630321 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-16c2b03e-55c0-43a3-bde9-4c5d2d67c89a tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: e7deeb40-9fc3-40f8-b564-192fe68fa113] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:12.637719 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-16c2b03e-55c0-43a3-bde9-4c5d2d67c89a tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:12.639591 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-16c2b03e-55c0-43a3-bde9-4c5d2d67c89a tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:12.639591 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-16c2b03e-55c0-43a3-bde9-4c5d2d67c89a tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:12.639591 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-16c2b03e-55c0-43a3-bde9-4c5d2d67c89a tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:12.647060 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-560e4dfc-6674-4a1c-84d8-33d80024e995 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: 9a2aa113-3a93-47a7-8b8f-82761ec366e5] Going to try to terminate instance {{(pid=129953) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 10:58:12.784352 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-16c2b03e-55c0-43a3-bde9-4c5d2d67c89a tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:12.792083 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-16c2b03e-55c0-43a3-bde9-4c5d2d67c89a tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/e7deeb40-9fc3-40f8-b564-192fe68fa113" status: 200 len: 1525 microversion: 2.1 time: 0.168075 Aug 02 10:58:12.792797 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 202/407] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:58:12 2022] GET /compute/v2.1/servers/e7deeb40-9fc3-40f8-b564-192fe68fa113 => generated 1525 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:58:12.945923 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-560e4dfc-6674-4a1c-84d8-33d80024e995 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "DELETE /compute/v2.1/servers/9a2aa113-3a93-47a7-8b8f-82761ec366e5" status: 204 len: 0 microversion: 2.1 time: 0.338625 Aug 02 10:58:12.946631 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 206/408] 10.222.0.115 () {58 vars in 1244 bytes} [Tue Aug 2 10:58:12 2022] DELETE /compute/v2.1/servers/9a2aa113-3a93-47a7-8b8f-82761ec366e5 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 10:58:12.955792 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-21dc510e-dc24-40d2-aaed-cca7a0df79b7 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:12.956411 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-21dc510e-dc24-40d2-aaed-cca7a0df79b7 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: 9a2aa113-3a93-47a7-8b8f-82761ec366e5] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:12.963181 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-21dc510e-dc24-40d2-aaed-cca7a0df79b7 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:12.963628 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-21dc510e-dc24-40d2-aaed-cca7a0df79b7 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:12.964407 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-21dc510e-dc24-40d2-aaed-cca7a0df79b7 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:12.964847 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-21dc510e-dc24-40d2-aaed-cca7a0df79b7 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:13.107585 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-21dc510e-dc24-40d2-aaed-cca7a0df79b7 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bc14ada1564911b2f0a698aef3f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a4a0cf1852449e8bfc59ddb5a902c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:13.115214 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-21dc510e-dc24-40d2-aaed-cca7a0df79b7 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "GET /compute/v2.1/servers/9a2aa113-3a93-47a7-8b8f-82761ec366e5" status: 200 len: 1685 microversion: 2.1 time: 0.163360 Aug 02 10:58:13.115783 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 203/409] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:58:12 2022] GET /compute/v2.1/servers/9a2aa113-3a93-47a7-8b8f-82761ec366e5 => generated 1685 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:58:13.538633 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-49201e1d-d572-4fb6-8811-42c1f5c9ce77 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:13.539367 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-49201e1d-d572-4fb6-8811-42c1f5c9ce77 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] [instance: 254a6894-dcb1-4909-a24e-a3a9bf701a83] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:13.546915 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-49201e1d-d572-4fb6-8811-42c1f5c9ce77 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:13.547422 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-49201e1d-d572-4fb6-8811-42c1f5c9ce77 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:13.555681 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-49201e1d-d572-4fb6-8811-42c1f5c9ce77 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:13.555681 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-49201e1d-d572-4fb6-8811-42c1f5c9ce77 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:13.555681 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG dbcounter [-] [129953] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:58:13.695682 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-49201e1d-d572-4fb6-8811-42c1f5c9ce77 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2664b70cbc1a41a59f78b0b7d4e86643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd54719e5f2b41e6a875361a9188d49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:13.703231 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-49201e1d-d572-4fb6-8811-42c1f5c9ce77 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] 10.222.0.115 "GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83" status: 200 len: 1264 microversion: 2.1 time: 0.168994 Aug 02 10:58:13.703806 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 207/410] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:58:13 2022] GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83 => generated 1264 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:58:13.813462 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-d6eb6ded-1d3b-49e5-a05c-e9d9b2a4dab3 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:13.814107 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-d6eb6ded-1d3b-49e5-a05c-e9d9b2a4dab3 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: e7deeb40-9fc3-40f8-b564-192fe68fa113] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:13.820605 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-d6eb6ded-1d3b-49e5-a05c-e9d9b2a4dab3 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:13.821046 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-d6eb6ded-1d3b-49e5-a05c-e9d9b2a4dab3 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:13.821879 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-d6eb6ded-1d3b-49e5-a05c-e9d9b2a4dab3 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:13.822358 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-d6eb6ded-1d3b-49e5-a05c-e9d9b2a4dab3 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:13.842106 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG dbcounter [-] [129952] Writing DB stats nova_cell1:SELECT=100 {{(pid=129952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:58:13.959569 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-d6eb6ded-1d3b-49e5-a05c-e9d9b2a4dab3 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:13.967830 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-d6eb6ded-1d3b-49e5-a05c-e9d9b2a4dab3 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/e7deeb40-9fc3-40f8-b564-192fe68fa113" status: 200 len: 1525 microversion: 2.1 time: 0.158253 Aug 02 10:58:13.968397 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 204/411] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:58:13 2022] GET /compute/v2.1/servers/e7deeb40-9fc3-40f8-b564-192fe68fa113 => generated 1525 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:58:14.138068 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-2b32a487-add8-4c52-95f3-fad3141bc906 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:14.138683 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-2b32a487-add8-4c52-95f3-fad3141bc906 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: 9a2aa113-3a93-47a7-8b8f-82761ec366e5] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:14.145765 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-2b32a487-add8-4c52-95f3-fad3141bc906 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:14.146218 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-2b32a487-add8-4c52-95f3-fad3141bc906 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:14.146985 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-2b32a487-add8-4c52-95f3-fad3141bc906 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:14.147686 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-2b32a487-add8-4c52-95f3-fad3141bc906 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:14.283758 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-2b32a487-add8-4c52-95f3-fad3141bc906 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bc14ada1564911b2f0a698aef3f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a4a0cf1852449e8bfc59ddb5a902c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:14.291281 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-2b32a487-add8-4c52-95f3-fad3141bc906 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "GET /compute/v2.1/servers/9a2aa113-3a93-47a7-8b8f-82761ec366e5" status: 200 len: 1685 microversion: 2.1 time: 0.157929 Aug 02 10:58:14.291850 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 208/412] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:58:14 2022] GET /compute/v2.1/servers/9a2aa113-3a93-47a7-8b8f-82761ec366e5 => generated 1685 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:58:14.725159 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-d5598e68-8dc1-4fc6-a362-0209a2aae799 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:14.725685 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-d5598e68-8dc1-4fc6-a362-0209a2aae799 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] [instance: 254a6894-dcb1-4909-a24e-a3a9bf701a83] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:14.732894 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-d5598e68-8dc1-4fc6-a362-0209a2aae799 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:14.733343 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-d5598e68-8dc1-4fc6-a362-0209a2aae799 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:14.734117 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-d5598e68-8dc1-4fc6-a362-0209a2aae799 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:14.734552 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-d5598e68-8dc1-4fc6-a362-0209a2aae799 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:14.870278 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-d5598e68-8dc1-4fc6-a362-0209a2aae799 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2664b70cbc1a41a59f78b0b7d4e86643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd54719e5f2b41e6a875361a9188d49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:14.878773 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-d5598e68-8dc1-4fc6-a362-0209a2aae799 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] 10.222.0.115 "GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83" status: 200 len: 1264 microversion: 2.1 time: 0.157599 Aug 02 10:58:14.879358 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 205/413] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:58:14 2022] GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83 => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:58:14.989688 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-133426b4-e0fc-45a7-a090-535ca598df1f tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:14.990210 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-133426b4-e0fc-45a7-a090-535ca598df1f tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: e7deeb40-9fc3-40f8-b564-192fe68fa113] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:14.997659 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-133426b4-e0fc-45a7-a090-535ca598df1f tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:14.998098 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-133426b4-e0fc-45a7-a090-535ca598df1f tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:14.998846 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-133426b4-e0fc-45a7-a090-535ca598df1f tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:14.999303 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-133426b4-e0fc-45a7-a090-535ca598df1f tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:15.132273 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-133426b4-e0fc-45a7-a090-535ca598df1f tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:15.139890 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-133426b4-e0fc-45a7-a090-535ca598df1f tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/e7deeb40-9fc3-40f8-b564-192fe68fa113" status: 200 len: 1525 microversion: 2.1 time: 0.154088 Aug 02 10:58:15.140484 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 209/414] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:58:14 2022] GET /compute/v2.1/servers/e7deeb40-9fc3-40f8-b564-192fe68fa113 => generated 1525 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:58:15.312697 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-17876a69-d288-4258-9314-f8a9c6ac9535 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:15.313483 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-17876a69-d288-4258-9314-f8a9c6ac9535 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: 9a2aa113-3a93-47a7-8b8f-82761ec366e5] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:15.319975 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-17876a69-d288-4258-9314-f8a9c6ac9535 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:15.320522 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-17876a69-d288-4258-9314-f8a9c6ac9535 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:15.321225 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-17876a69-d288-4258-9314-f8a9c6ac9535 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:15.321666 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-17876a69-d288-4258-9314-f8a9c6ac9535 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:15.376991 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [req-081f0d6d-5282-460d-8f41-4fa008fe7a71 req-f7f94db2-1135-4038-a655-433c7415c21d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "254a6894-dcb1-4909-a24e-a3a9bf701a83", "name": "network-vif-plugged", "status": "completed", "tag": "950f72fe-d9c4-4546-b649-bf02fe995cd8"}]} {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:58:15.388201 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [req-081f0d6d-5282-460d-8f41-4fa008fe7a71 req-f7f94db2-1135-4038-a655-433c7415c21d service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:15.392694 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [req-081f0d6d-5282-460d-8f41-4fa008fe7a71 req-f7f94db2-1135-4038-a655-433c7415c21d service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:15.400620 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.compute.server_external_events [req-081f0d6d-5282-460d-8f41-4fa008fe7a71 req-f7f94db2-1135-4038-a655-433c7415c21d service nova] Creating event network-vif-plugged:950f72fe-d9c4-4546-b649-bf02fe995cd8 for instance 254a6894-dcb1-4909-a24e-a3a9bf701a83 on hv-cinder-85031 Aug 02 10:58:15.406059 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [req-081f0d6d-5282-460d-8f41-4fa008fe7a71 req-f7f94db2-1135-4038-a655-433c7415c21d service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033847 Aug 02 10:58:15.406669 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 210/415] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Aug 2 10:58:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:58:15.470539 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-17876a69-d288-4258-9314-f8a9c6ac9535 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bc14ada1564911b2f0a698aef3f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a4a0cf1852449e8bfc59ddb5a902c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:15.478122 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-17876a69-d288-4258-9314-f8a9c6ac9535 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "GET /compute/v2.1/servers/9a2aa113-3a93-47a7-8b8f-82761ec366e5" status: 200 len: 1685 microversion: 2.1 time: 0.169419 Aug 02 10:58:15.478960 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 206/416] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:58:15 2022] GET /compute/v2.1/servers/9a2aa113-3a93-47a7-8b8f-82761ec366e5 => generated 1685 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:58:15.900173 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-2b4c4fc0-4bac-4776-aec0-ac12e5ac9f92 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:15.900880 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-2b4c4fc0-4bac-4776-aec0-ac12e5ac9f92 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] [instance: 254a6894-dcb1-4909-a24e-a3a9bf701a83] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:15.908585 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-2b4c4fc0-4bac-4776-aec0-ac12e5ac9f92 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:15.909029 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-2b4c4fc0-4bac-4776-aec0-ac12e5ac9f92 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:15.909787 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-2b4c4fc0-4bac-4776-aec0-ac12e5ac9f92 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:15.910215 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-2b4c4fc0-4bac-4776-aec0-ac12e5ac9f92 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:16.046750 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-2b4c4fc0-4bac-4776-aec0-ac12e5ac9f92 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2664b70cbc1a41a59f78b0b7d4e86643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd54719e5f2b41e6a875361a9188d49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:16.054507 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-2b4c4fc0-4bac-4776-aec0-ac12e5ac9f92 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] 10.222.0.115 "GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83" status: 200 len: 1264 microversion: 2.1 time: 0.158622 Aug 02 10:58:16.055099 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 211/417] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:58:15 2022] GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83 => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:58:16.163038 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-3c01fb65-ec94-453d-bf94-b39a514e289d tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:16.163685 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-3c01fb65-ec94-453d-bf94-b39a514e289d tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: e7deeb40-9fc3-40f8-b564-192fe68fa113] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:16.170205 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-3c01fb65-ec94-453d-bf94-b39a514e289d tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:16.171483 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-3c01fb65-ec94-453d-bf94-b39a514e289d tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:16.171483 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-3c01fb65-ec94-453d-bf94-b39a514e289d tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:16.171865 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-3c01fb65-ec94-453d-bf94-b39a514e289d tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:16.320288 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-3c01fb65-ec94-453d-bf94-b39a514e289d tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:16.329681 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-3c01fb65-ec94-453d-bf94-b39a514e289d tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/e7deeb40-9fc3-40f8-b564-192fe68fa113" status: 200 len: 1525 microversion: 2.1 time: 0.170604 Aug 02 10:58:16.330318 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 207/418] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:58:16 2022] GET /compute/v2.1/servers/e7deeb40-9fc3-40f8-b564-192fe68fa113 => generated 1525 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:58:16.501061 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-9f69bc22-1511-4d15-8fe7-8130ff0518a5 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:16.501972 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-9f69bc22-1511-4d15-8fe7-8130ff0518a5 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: 9a2aa113-3a93-47a7-8b8f-82761ec366e5] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:16.508833 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-9f69bc22-1511-4d15-8fe7-8130ff0518a5 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:16.509531 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-9f69bc22-1511-4d15-8fe7-8130ff0518a5 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:16.510513 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-9f69bc22-1511-4d15-8fe7-8130ff0518a5 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:16.511646 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-9f69bc22-1511-4d15-8fe7-8130ff0518a5 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:16.551715 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [req-0e444f2d-93cb-484d-866f-756758789daf req-c3a4e327-a4c8-4ad0-b848-605c4d3b180f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a2aa113-3a93-47a7-8b8f-82761ec366e5", "name": "network-vif-deleted", "tag": "c5e050fb-f15e-4f37-af10-39c26d5ad028"}]} {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:58:16.562017 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [req-0e444f2d-93cb-484d-866f-756758789daf req-c3a4e327-a4c8-4ad0-b848-605c4d3b180f service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:16.562868 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [req-0e444f2d-93cb-484d-866f-756758789daf req-c3a4e327-a4c8-4ad0-b848-605c4d3b180f service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:16.590660 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-9f69bc22-1511-4d15-8fe7-8130ff0518a5 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bc14ada1564911b2f0a698aef3f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a4a0cf1852449e8bfc59ddb5a902c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:16.598607 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.compute.server_external_events [req-0e444f2d-93cb-484d-866f-756758789daf req-c3a4e327-a4c8-4ad0-b848-605c4d3b180f service nova] Creating event network-vif-deleted:c5e050fb-f15e-4f37-af10-39c26d5ad028 for instance 9a2aa113-3a93-47a7-8b8f-82761ec366e5 on hv-cinder-85031 Aug 02 10:58:16.598814 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-9f69bc22-1511-4d15-8fe7-8130ff0518a5 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "GET /compute/v2.1/servers/9a2aa113-3a93-47a7-8b8f-82761ec366e5" status: 200 len: 1617 microversion: 2.1 time: 0.101534 Aug 02 10:58:16.599523 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 212/419] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:58:16 2022] GET /compute/v2.1/servers/9a2aa113-3a93-47a7-8b8f-82761ec366e5 => generated 1617 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:58:16.623886 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [req-0e444f2d-93cb-484d-866f-756758789daf req-c3a4e327-a4c8-4ad0-b848-605c4d3b180f service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075397 Aug 02 10:58:16.625273 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 208/420] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Aug 2 10:58:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:58:17.077234 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-df6ac8e4-8b3c-46ce-8b76-95c09b21652e tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:17.077786 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-df6ac8e4-8b3c-46ce-8b76-95c09b21652e tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] [instance: 254a6894-dcb1-4909-a24e-a3a9bf701a83] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:17.084084 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-df6ac8e4-8b3c-46ce-8b76-95c09b21652e tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:17.084531 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-df6ac8e4-8b3c-46ce-8b76-95c09b21652e tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:17.085306 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-df6ac8e4-8b3c-46ce-8b76-95c09b21652e tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:17.085732 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-df6ac8e4-8b3c-46ce-8b76-95c09b21652e tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:17.250408 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-df6ac8e4-8b3c-46ce-8b76-95c09b21652e tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2664b70cbc1a41a59f78b0b7d4e86643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd54719e5f2b41e6a875361a9188d49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:17.262657 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-df6ac8e4-8b3c-46ce-8b76-95c09b21652e tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] 10.222.0.115 "GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83" status: 200 len: 1264 microversion: 2.1 time: 0.189718 Aug 02 10:58:17.271117 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 213/421] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:58:17 2022] GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83 => generated 1264 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:58:17.352233 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-376fbff6-5e5c-4c5f-bb8e-45d547e70e18 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:17.353692 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-376fbff6-5e5c-4c5f-bb8e-45d547e70e18 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: e7deeb40-9fc3-40f8-b564-192fe68fa113] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:17.361412 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-376fbff6-5e5c-4c5f-bb8e-45d547e70e18 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:17.365498 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-376fbff6-5e5c-4c5f-bb8e-45d547e70e18 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:17.365498 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-376fbff6-5e5c-4c5f-bb8e-45d547e70e18 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:17.365498 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-376fbff6-5e5c-4c5f-bb8e-45d547e70e18 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:17.517357 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-376fbff6-5e5c-4c5f-bb8e-45d547e70e18 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:17.525361 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-376fbff6-5e5c-4c5f-bb8e-45d547e70e18 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/e7deeb40-9fc3-40f8-b564-192fe68fa113" status: 200 len: 1525 microversion: 2.1 time: 0.177488 Aug 02 10:58:17.526077 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 209/422] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:58:17 2022] GET /compute/v2.1/servers/e7deeb40-9fc3-40f8-b564-192fe68fa113 => generated 1525 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:58:17.623821 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-63910667-3ccf-459d-a38c-9e89769f7e8d tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:17.624552 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-63910667-3ccf-459d-a38c-9e89769f7e8d tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: 9a2aa113-3a93-47a7-8b8f-82761ec366e5] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:17.631211 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-63910667-3ccf-459d-a38c-9e89769f7e8d tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:17.631655 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-63910667-3ccf-459d-a38c-9e89769f7e8d tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:17.632616 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-63910667-3ccf-459d-a38c-9e89769f7e8d tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:17.633050 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-63910667-3ccf-459d-a38c-9e89769f7e8d tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:17.673650 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-63910667-3ccf-459d-a38c-9e89769f7e8d tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:17.674134 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-63910667-3ccf-459d-a38c-9e89769f7e8d tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:17.674597 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.objects.instance [None req-63910667-3ccf-459d-a38c-9e89769f7e8d tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lazy-loading 'fault' on Instance uuid 9a2aa113-3a93-47a7-8b8f-82761ec366e5 {{(pid=129953) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 10:58:17.723454 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-63910667-3ccf-459d-a38c-9e89769f7e8d tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bc14ada1564911b2f0a698aef3f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a4a0cf1852449e8bfc59ddb5a902c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:17.730928 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-63910667-3ccf-459d-a38c-9e89769f7e8d tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "GET /compute/v2.1/servers/9a2aa113-3a93-47a7-8b8f-82761ec366e5" status: 200 len: 1334 microversion: 2.1 time: 0.111761 Aug 02 10:58:17.731548 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 214/423] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:58:17 2022] GET /compute/v2.1/servers/9a2aa113-3a93-47a7-8b8f-82761ec366e5 => generated 1334 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:58:18.285521 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-4ab0ae0f-41a1-46fb-97bb-75c34da88ccb tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:18.286133 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-4ab0ae0f-41a1-46fb-97bb-75c34da88ccb tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] [instance: 254a6894-dcb1-4909-a24e-a3a9bf701a83] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:18.292410 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-4ab0ae0f-41a1-46fb-97bb-75c34da88ccb tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:18.292954 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-4ab0ae0f-41a1-46fb-97bb-75c34da88ccb tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:18.293725 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-4ab0ae0f-41a1-46fb-97bb-75c34da88ccb tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:18.294160 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-4ab0ae0f-41a1-46fb-97bb-75c34da88ccb tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:18.428158 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-4ab0ae0f-41a1-46fb-97bb-75c34da88ccb tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2664b70cbc1a41a59f78b0b7d4e86643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd54719e5f2b41e6a875361a9188d49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:18.436415 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-4ab0ae0f-41a1-46fb-97bb-75c34da88ccb tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] 10.222.0.115 "GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83" status: 200 len: 1264 microversion: 2.1 time: 0.154968 Aug 02 10:58:18.436993 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 210/424] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:58:18 2022] GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:58:18.547765 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-17737b51-d60a-46dc-81a4-cf12ab89f5b5 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:18.548381 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-17737b51-d60a-46dc-81a4-cf12ab89f5b5 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: e7deeb40-9fc3-40f8-b564-192fe68fa113] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:18.555404 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-17737b51-d60a-46dc-81a4-cf12ab89f5b5 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:18.555852 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-17737b51-d60a-46dc-81a4-cf12ab89f5b5 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:18.556617 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-17737b51-d60a-46dc-81a4-cf12ab89f5b5 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:18.557055 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-17737b51-d60a-46dc-81a4-cf12ab89f5b5 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:18.697869 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-17737b51-d60a-46dc-81a4-cf12ab89f5b5 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:18.706180 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-17737b51-d60a-46dc-81a4-cf12ab89f5b5 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/e7deeb40-9fc3-40f8-b564-192fe68fa113" status: 200 len: 1525 microversion: 2.1 time: 0.162321 Aug 02 10:58:18.706761 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 215/425] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:58:18 2022] GET /compute/v2.1/servers/e7deeb40-9fc3-40f8-b564-192fe68fa113 => generated 1525 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:58:18.757150 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-eb4bbb94-9e2c-467c-985b-4c89e87cf4bc tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:18.758255 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-eb4bbb94-9e2c-467c-985b-4c89e87cf4bc tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: 9a2aa113-3a93-47a7-8b8f-82761ec366e5] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:18.764877 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-eb4bbb94-9e2c-467c-985b-4c89e87cf4bc tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:18.765324 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-eb4bbb94-9e2c-467c-985b-4c89e87cf4bc tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:18.766095 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-eb4bbb94-9e2c-467c-985b-4c89e87cf4bc tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:18.766522 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-eb4bbb94-9e2c-467c-985b-4c89e87cf4bc tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:18.801578 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-eb4bbb94-9e2c-467c-985b-4c89e87cf4bc tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:18.801578 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-eb4bbb94-9e2c-467c-985b-4c89e87cf4bc tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:18.801578 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.objects.instance [None req-eb4bbb94-9e2c-467c-985b-4c89e87cf4bc tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lazy-loading 'fault' on Instance uuid 9a2aa113-3a93-47a7-8b8f-82761ec366e5 {{(pid=129952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 10:58:18.842271 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-eb4bbb94-9e2c-467c-985b-4c89e87cf4bc tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bc14ada1564911b2f0a698aef3f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a4a0cf1852449e8bfc59ddb5a902c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:18.849651 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-eb4bbb94-9e2c-467c-985b-4c89e87cf4bc tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "GET /compute/v2.1/servers/9a2aa113-3a93-47a7-8b8f-82761ec366e5" status: 200 len: 1334 microversion: 2.1 time: 0.100100 Aug 02 10:58:18.850204 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 211/426] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:58:18 2022] GET /compute/v2.1/servers/9a2aa113-3a93-47a7-8b8f-82761ec366e5 => generated 1334 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:58:19.458078 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-94053e78-2424-460d-add9-cc1cfe3045bd tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:19.458856 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-94053e78-2424-460d-add9-cc1cfe3045bd tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] [instance: 254a6894-dcb1-4909-a24e-a3a9bf701a83] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:19.465686 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-94053e78-2424-460d-add9-cc1cfe3045bd tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:19.466121 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-94053e78-2424-460d-add9-cc1cfe3045bd tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:19.466876 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-94053e78-2424-460d-add9-cc1cfe3045bd tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:19.467331 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-94053e78-2424-460d-add9-cc1cfe3045bd tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:19.601841 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-94053e78-2424-460d-add9-cc1cfe3045bd tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2664b70cbc1a41a59f78b0b7d4e86643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd54719e5f2b41e6a875361a9188d49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:19.609768 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-94053e78-2424-460d-add9-cc1cfe3045bd tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] 10.222.0.115 "GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83" status: 200 len: 1264 microversion: 2.1 time: 0.155625 Aug 02 10:58:19.610332 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 216/427] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:58:19 2022] GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:58:19.727260 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-a8b4c206-a4f3-46e4-b467-edfc55b5ecb9 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:19.727782 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-a8b4c206-a4f3-46e4-b467-edfc55b5ecb9 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: e7deeb40-9fc3-40f8-b564-192fe68fa113] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:19.734487 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-a8b4c206-a4f3-46e4-b467-edfc55b5ecb9 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:19.734924 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-a8b4c206-a4f3-46e4-b467-edfc55b5ecb9 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:19.735715 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-a8b4c206-a4f3-46e4-b467-edfc55b5ecb9 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:19.736141 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-a8b4c206-a4f3-46e4-b467-edfc55b5ecb9 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:19.871973 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-a8b4c206-a4f3-46e4-b467-edfc55b5ecb9 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:19.875122 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-64f21c37-6305-4452-bd9a-1cca257edc73 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:19.875743 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-64f21c37-6305-4452-bd9a-1cca257edc73 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: 9a2aa113-3a93-47a7-8b8f-82761ec366e5] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:19.879895 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-a8b4c206-a4f3-46e4-b467-edfc55b5ecb9 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/e7deeb40-9fc3-40f8-b564-192fe68fa113" status: 200 len: 1505 microversion: 2.1 time: 0.156655 Aug 02 10:58:19.880663 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 212/428] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:58:19 2022] GET /compute/v2.1/servers/e7deeb40-9fc3-40f8-b564-192fe68fa113 => generated 1505 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:58:19.882436 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-64f21c37-6305-4452-bd9a-1cca257edc73 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:19.882973 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-64f21c37-6305-4452-bd9a-1cca257edc73 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:19.886768 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-64f21c37-6305-4452-bd9a-1cca257edc73 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:19.886768 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-64f21c37-6305-4452-bd9a-1cca257edc73 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:19.899321 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.wsgi [None req-64f21c37-6305-4452-bd9a-1cca257edc73 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] HTTP exception thrown: Instance 9a2aa113-3a93-47a7-8b8f-82761ec366e5 could not be found. Aug 02 10:58:19.900895 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-2f7b1f7b-1495-42be-bf87-72efe028e4d5 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "363cffbe-7a61-4ed5-9f71-8a55c16bae63"}} {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:58:19.901096 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-64f21c37-6305-4452-bd9a-1cca257edc73 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Request method failure captured: Aug 02 10:58:19.901096 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: request: GET /compute/v2.1/servers/9a2aa113-3a93-47a7-8b8f-82761ec366e5 HTTP/1.1 Aug 02 10:58:19.901096 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Accept: application/json Aug 02 10:58:19.901096 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Accept-Encoding: identity Aug 02 10:58:19.901096 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Connection: close Aug 02 10:58:19.901096 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Content-Length: 0 Aug 02 10:58:19.901096 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Content-Type: application/json Aug 02 10:58:19.901096 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Host: 10.222.0.115 Aug 02 10:58:19.901096 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Openstack-System-Scope: None Aug 02 10:58:19.901096 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: User-Agent: python-urllib3/1.26.10 Aug 02 10:58:19.901096 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Auth-Token: gAAAAABi6QKMm0zWjcrgGxsKGjmUpSACSDsl300OSZbmfbKI8W7YRiqQlsT7G2Yz8bTCtqeY5P5LouAzxFYTu1e6mP7SLmcSkT2w0SAqH9Ev0MtEiqJ7hFJOgCTtlSAmMKZk3KczE4deWY0afZWtzWq9Z6D1UUJ57x6ix6Lv8M0Q8lVdVaQlJYs Aug 02 10:58:19.901096 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Domain-Id: None Aug 02 10:58:19.901096 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Domain-Name: None Aug 02 10:58:19.901096 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Identity-Status: Confirmed Aug 02 10:58:19.901096 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Is-Admin-Project: True Aug 02 10:58:19.901096 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Project-Domain-Id: default Aug 02 10:58:19.901096 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Project-Domain-Name: Default Aug 02 10:58:19.901096 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Project-Id: 89a4a0cf1852449e8bfc59ddb5a902c1 Aug 02 10:58:19.901096 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Project-Name: tempest-AttachVolumeNegativeTest-1965368294 Aug 02 10:58:19.901096 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Role: reader,member Aug 02 10:58:19.901096 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Roles: reader,member Aug 02 10:58:19.902841 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/89a4a0cf1852449e8bfc59ddb5a902c1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2/89a4a0cf1852449e8bfc59ddb5a902c1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/89a4a0cf1852449e8bfc59ddb5a902c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.115:8080", "publicURL": "http://10.222.0.115:8080/v1/AUTH_89a4a0cf1852449e8bfc59ddb5a902c1"}]}] Aug 02 10:58:19.902841 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Tenant: tempest-AttachVolumeNegativeTest-1965368294 Aug 02 10:58:19.902841 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Tenant-Id: 89a4a0cf1852449e8bfc59ddb5a902c1 Aug 02 10:58:19.902841 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1965368294 Aug 02 10:58:19.902841 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User: tempest-AttachVolumeNegativeTest-1965368294-project Aug 02 10:58:19.902841 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User-Domain-Id: default Aug 02 10:58:19.902841 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User-Domain-Name: Default Aug 02 10:58:19.902841 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User-Id: 53bc14ada1564911b2f0a698aef3f333 Aug 02 10:58:19.902841 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User-Name: tempest-AttachVolumeNegativeTest-1965368294-project Aug 02 10:58:19.902841 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: method: > Aug 02 10:58:19.902841 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: exception: Instance 9a2aa113-3a93-47a7-8b8f-82761ec366e5 could not be found. Aug 02 10:58:19.902841 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: action_args: {'id': '9a2aa113-3a93-47a7-8b8f-82761ec366e5'} Aug 02 10:58:19.903647 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:58:19.903647 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:58:19.903647 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 10:58:19.903647 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 10:58:19.903647 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 10:58:19.903647 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 10:58:19.903647 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 10:58:19.903647 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 10:58:19.903647 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 10:58:19.903647 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 10:58:19.903647 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a2aa113-3a93-47a7-8b8f-82761ec366e5 could not be found. Aug 02 10:58:19.903647 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 10:58:19.903647 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:58:19.903647 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 10:58:19.903647 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:58:19.903647 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:58:19.903647 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:58:19.903647 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:58:19.903647 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:58:19.903647 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:58:19.904852 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:58:19.904852 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 10:58:19.904852 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 10:58:19.904852 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 10:58:19.904852 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 10:58:19.904852 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 10:58:19.904852 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 10:58:19.904852 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a2aa113-3a93-47a7-8b8f-82761ec366e5 could not be found. Aug 02 10:58:19.904852 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 10:58:19.904852 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:58:19.904852 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 10:58:19.904852 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:58:19.904852 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:58:19.904852 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:58:19.904852 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:58:19.904852 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:58:19.904852 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a2aa113-3a93-47a7-8b8f-82761ec366e5 could not be found. Aug 02 10:58:19.904852 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 10:58:19.905900 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-64f21c37-6305-4452-bd9a-1cca257edc73 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Returning 404 to user: Instance 9a2aa113-3a93-47a7-8b8f-82761ec366e5 could not be found. {{(pid=129953) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:58:19.905900 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-64f21c37-6305-4452-bd9a-1cca257edc73 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "GET /compute/v2.1/servers/9a2aa113-3a93-47a7-8b8f-82761ec366e5" status: 404 len: 111 microversion: 2.1 time: 0.033216 Aug 02 10:58:19.905900 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 217/429] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:58:19 2022] GET /compute/v2.1/servers/9a2aa113-3a93-47a7-8b8f-82761ec366e5 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 10:58:19.906089 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-2f7b1f7b-1495-42be-bf87-72efe028e4d5 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: e7deeb40-9fc3-40f8-b564-192fe68fa113] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:19.910034 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-2f7b1f7b-1495-42be-bf87-72efe028e4d5 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:19.910498 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-2f7b1f7b-1495-42be-bf87-72efe028e4d5 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:19.911289 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-2f7b1f7b-1495-42be-bf87-72efe028e4d5 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:19.911740 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-2f7b1f7b-1495-42be-bf87-72efe028e4d5 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:19.911880 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-54f59cc8-cde8-45b3-87c1-21a63309b9ca tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Calling method '.version_select at 0x7f7c4e63d820>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:19.936380 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.wsgi [None req-2f7b1f7b-1495-42be-bf87-72efe028e4d5 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] HTTP exception thrown: Cannot 'attach_volume' instance e7deeb40-9fc3-40f8-b564-192fe68fa113 while it is in vm_state rescued Aug 02 10:58:19.938092 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-2f7b1f7b-1495-42be-bf87-72efe028e4d5 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Request method failure captured: Aug 02 10:58:19.938092 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: request: POST /compute/v2.1/servers/e7deeb40-9fc3-40f8-b564-192fe68fa113/os-volume_attachments HTTP/1.1 Aug 02 10:58:19.938092 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Accept: application/json Aug 02 10:58:19.938092 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Accept-Encoding: identity Aug 02 10:58:19.938092 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Connection: close Aug 02 10:58:19.938092 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Content-Length: 74 Aug 02 10:58:19.938092 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Content-Type: application/json Aug 02 10:58:19.938092 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Host: 10.222.0.115 Aug 02 10:58:19.938092 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Openstack-System-Scope: None Aug 02 10:58:19.938092 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: User-Agent: python-urllib3/1.26.10 Aug 02 10:58:19.938092 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Auth-Token: gAAAAABi6QLU4-kFVceoHWEpo94bbvBf1uqlEx4Gmz_ix8LIhs0hb3WYrUk_oMQ3oj3o3ZEWUh1MDl3j04cDaiOxlt6Nmx19h9H9o9YzMFcctjtmr66KQ4MTn2pZ5x6hWud4Dyg2XcQVpsrwtFErHKVVnsJz6A5M7HawuEHdbt-qhQJOR6Lin2k Aug 02 10:58:19.938092 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Domain-Id: None Aug 02 10:58:19.938092 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Domain-Name: None Aug 02 10:58:19.938092 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Identity-Status: Confirmed Aug 02 10:58:19.938092 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Is-Admin-Project: True Aug 02 10:58:19.938092 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Project-Domain-Id: default Aug 02 10:58:19.938092 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Project-Domain-Name: Default Aug 02 10:58:19.938092 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Project-Id: 0d99d3fd13df429a8ee8a7cb7780adb5 Aug 02 10:58:19.938092 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1563347873 Aug 02 10:58:19.938092 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Role: reader,member Aug 02 10:58:19.938092 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Roles: reader,member Aug 02 10:58:19.939792 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/0d99d3fd13df429a8ee8a7cb7780adb5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2/0d99d3fd13df429a8ee8a7cb7780adb5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/0d99d3fd13df429a8ee8a7cb7780adb5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.115:8080", "publicURL": "http://10.222.0.115:8080/v1/AUTH_0d99d3fd13df429a8ee8a7cb7780adb5"}]}] Aug 02 10:58:19.939792 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1563347873 Aug 02 10:58:19.939792 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Tenant-Id: 0d99d3fd13df429a8ee8a7cb7780adb5 Aug 02 10:58:19.939792 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1563347873 Aug 02 10:58:19.939792 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User: tempest-ServerRescueNegativeTestJSON-1563347873-project Aug 02 10:58:19.939792 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User-Domain-Id: default Aug 02 10:58:19.939792 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User-Domain-Name: Default Aug 02 10:58:19.939792 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User-Id: 3057a53debc34c829372c03567e1119d Aug 02 10:58:19.939792 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1563347873-project Aug 02 10:58:19.939792 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Aug 02 10:58:19.939792 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: {"volumeAttachment": {"volumeId": "363cffbe-7a61-4ed5-9f71-8a55c16bae63"}} Aug 02 10:58:19.939792 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: method: > Aug 02 10:58:19.940655 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: exception: Cannot 'attach_volume' instance e7deeb40-9fc3-40f8-b564-192fe68fa113 while it is in vm_state rescued Aug 02 10:58:19.940655 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: action_args: {'server_id': 'e7deeb40-9fc3-40f8-b564-192fe68fa113', 'body': {'volumeAttachment': {'volumeId': '363cffbe-7a61-4ed5-9f71-8a55c16bae63'}}} Aug 02 10:58:19.940655 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:58:19.940655 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:58:19.940655 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 02 10:58:19.940655 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 02 10:58:19.940655 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 02 10:58:19.940655 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 02 10:58:19.940655 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 02 10:58:19.940655 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 02 10:58:19.940655 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e7deeb40-9fc3-40f8-b564-192fe68fa113 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 02 10:58:19.940655 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 10:58:19.940655 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:58:19.940655 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 10:58:19.940655 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:58:19.940655 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:58:19.940655 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:58:19.940655 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:58:19.940655 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:58:19.942148 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:58:19.942148 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:58:19.942148 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 10:58:19.942148 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 10:58:19.942148 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 10:58:19.942148 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 10:58:19.942148 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 10:58:19.942148 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 10:58:19.942148 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 02 10:58:19.942148 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 02 10:58:19.942148 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 02 10:58:19.942148 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 02 10:58:19.942148 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance e7deeb40-9fc3-40f8-b564-192fe68fa113 while it is in vm_state rescued Aug 02 10:58:19.942148 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 10:58:19.942148 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:58:19.942148 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 10:58:19.942148 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:58:19.942148 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:58:19.942148 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:58:19.943585 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:58:19.943585 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:58:19.943585 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance e7deeb40-9fc3-40f8-b564-192fe68fa113 while it is in vm_state rescued Aug 02 10:58:19.943585 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 10:58:19.943585 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-2f7b1f7b-1495-42be-bf87-72efe028e4d5 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Returning 409 to user: Cannot 'attach_volume' instance e7deeb40-9fc3-40f8-b564-192fe68fa113 while it is in vm_state rescued {{(pid=129952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:58:19.943585 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-2f7b1f7b-1495-42be-bf87-72efe028e4d5 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "POST /compute/v2.1/servers/e7deeb40-9fc3-40f8-b564-192fe68fa113/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.042538 Aug 02 10:58:19.943585 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 213/430] 10.222.0.115 () {60 vars in 1328 bytes} [Tue Aug 2 10:58:19 2022] POST /compute/v2.1/servers/e7deeb40-9fc3-40f8-b564-192fe68fa113/os-volume_attachments => generated 152 bytes in 44 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 02 10:58:19.948127 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-1684452a-e13f-489b-a540-e25963ae40ac tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:58:19.949262 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-1684452a-e13f-489b-a540-e25963ae40ac tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: e7deeb40-9fc3-40f8-b564-192fe68fa113] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:19.955398 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-1684452a-e13f-489b-a540-e25963ae40ac tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:19.955834 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-1684452a-e13f-489b-a540-e25963ae40ac tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:19.956582 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-1684452a-e13f-489b-a540-e25963ae40ac tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:19.957006 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-1684452a-e13f-489b-a540-e25963ae40ac tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:20.004109 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-54f59cc8-cde8-45b3-87c1-21a63309b9ca tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-56915147" status: 202 len: 0 microversion: 2.1 time: 0.095745 Aug 02 10:58:20.004693 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 218/431] 10.222.0.115 () {58 vars in 1220 bytes} [Tue Aug 2 10:58:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-56915147 => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 10:58:20.189173 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-1684452a-e13f-489b-a540-e25963ae40ac tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "POST /compute/v2.1/servers/e7deeb40-9fc3-40f8-b564-192fe68fa113/action" status: 202 len: 0 microversion: 2.1 time: 0.244424 Aug 02 10:58:20.189846 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 214/432] 10.222.0.115 () {60 vars in 1283 bytes} [Tue Aug 2 10:58:19 2022] POST /compute/v2.1/servers/e7deeb40-9fc3-40f8-b564-192fe68fa113/action => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 02 10:58:20.198040 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-d51ff953-1d3a-4373-ae41-5dcda24b2bdb tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:20.199273 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-d51ff953-1d3a-4373-ae41-5dcda24b2bdb tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: e7deeb40-9fc3-40f8-b564-192fe68fa113] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:20.206162 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-d51ff953-1d3a-4373-ae41-5dcda24b2bdb tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:20.206601 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-d51ff953-1d3a-4373-ae41-5dcda24b2bdb tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:20.207393 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-d51ff953-1d3a-4373-ae41-5dcda24b2bdb tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:20.207818 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-d51ff953-1d3a-4373-ae41-5dcda24b2bdb tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:20.353068 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-d51ff953-1d3a-4373-ae41-5dcda24b2bdb tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:20.360917 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-d51ff953-1d3a-4373-ae41-5dcda24b2bdb tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/e7deeb40-9fc3-40f8-b564-192fe68fa113" status: 200 len: 1513 microversion: 2.1 time: 0.166714 Aug 02 10:58:20.361493 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 219/433] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:58:20 2022] GET /compute/v2.1/servers/e7deeb40-9fc3-40f8-b564-192fe68fa113 => generated 1513 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:58:20.631459 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-b0cb3f11-e0d2-4933-8ee2-97ec1b5256bb tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:20.632155 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-b0cb3f11-e0d2-4933-8ee2-97ec1b5256bb tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] [instance: 254a6894-dcb1-4909-a24e-a3a9bf701a83] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:20.639579 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-b0cb3f11-e0d2-4933-8ee2-97ec1b5256bb tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:20.640023 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-b0cb3f11-e0d2-4933-8ee2-97ec1b5256bb tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:20.640836 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-b0cb3f11-e0d2-4933-8ee2-97ec1b5256bb tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:20.641248 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-b0cb3f11-e0d2-4933-8ee2-97ec1b5256bb tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:20.775628 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-b0cb3f11-e0d2-4933-8ee2-97ec1b5256bb tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2664b70cbc1a41a59f78b0b7d4e86643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd54719e5f2b41e6a875361a9188d49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:20.784298 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-b0cb3f11-e0d2-4933-8ee2-97ec1b5256bb tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] 10.222.0.115 "GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83" status: 200 len: 1446 microversion: 2.1 time: 0.157096 Aug 02 10:58:20.784962 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 215/434] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:58:20 2022] GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83 => generated 1446 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:58:20.806475 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-1626ad24-0dde-43c4-be11-cac84ae82131 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:20.807769 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-1626ad24-0dde-43c4-be11-cac84ae82131 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] [instance: 254a6894-dcb1-4909-a24e-a3a9bf701a83] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:20.810908 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG dbcounter [-] [129953] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:58:20.814407 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-1626ad24-0dde-43c4-be11-cac84ae82131 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:20.814846 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-1626ad24-0dde-43c4-be11-cac84ae82131 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:20.815712 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-1626ad24-0dde-43c4-be11-cac84ae82131 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:20.816142 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-1626ad24-0dde-43c4-be11-cac84ae82131 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:20.955356 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-1626ad24-0dde-43c4-be11-cac84ae82131 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2664b70cbc1a41a59f78b0b7d4e86643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd54719e5f2b41e6a875361a9188d49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:20.963280 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-1626ad24-0dde-43c4-be11-cac84ae82131 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] 10.222.0.115 "GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83" status: 200 len: 1446 microversion: 2.1 time: 0.161289 Aug 02 10:58:20.963960 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 220/435] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:58:20 2022] GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83 => generated 1446 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:58:21.134870 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-20f42d07-0032-4779-a750-d6c2c74304ed tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:21.135468 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-20f42d07-0032-4779-a750-d6c2c74304ed tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: 8a7b8f4c-0c11-406f-bed6-b4fd18e3c304] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:21.141774 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-20f42d07-0032-4779-a750-d6c2c74304ed tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:21.142230 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-20f42d07-0032-4779-a750-d6c2c74304ed tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:21.143161 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-20f42d07-0032-4779-a750-d6c2c74304ed tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:21.143600 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-20f42d07-0032-4779-a750-d6c2c74304ed tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:21.279571 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.objects.instance [None req-20f42d07-0032-4779-a750-d6c2c74304ed tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lazy-loading 'services' on Instance uuid 8a7b8f4c-0c11-406f-bed6-b4fd18e3c304 {{(pid=129952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 10:58:21.381618 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-4ad95db8-5e12-41db-b308-b40b1377e9bb tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:21.382960 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-4ad95db8-5e12-41db-b308-b40b1377e9bb tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: e7deeb40-9fc3-40f8-b564-192fe68fa113] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:21.392863 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-4ad95db8-5e12-41db-b308-b40b1377e9bb tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:21.392863 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-4ad95db8-5e12-41db-b308-b40b1377e9bb tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:21.392863 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-4ad95db8-5e12-41db-b308-b40b1377e9bb tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:21.392863 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-4ad95db8-5e12-41db-b308-b40b1377e9bb tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:21.590649 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-4ad95db8-5e12-41db-b308-b40b1377e9bb tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:21.598327 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-4ad95db8-5e12-41db-b308-b40b1377e9bb tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/e7deeb40-9fc3-40f8-b564-192fe68fa113" status: 200 len: 1513 microversion: 2.1 time: 0.220440 Aug 02 10:58:21.598862 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 221/436] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:58:21 2022] GET /compute/v2.1/servers/e7deeb40-9fc3-40f8-b564-192fe68fa113 => generated 1513 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:58:21.637500 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-20f42d07-0032-4779-a750-d6c2c74304ed tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "DELETE /compute/v2.1/servers/8a7b8f4c-0c11-406f-bed6-b4fd18e3c304/os-volume_attachments/9de4c0fd-b9a7-40d2-b857-8cc654a6f15a" status: 202 len: 0 microversion: 2.1 time: 0.505914 Aug 02 10:58:21.644109 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 216/437] 10.222.0.115 () {58 vars in 1421 bytes} [Tue Aug 2 10:58:21 2022] DELETE /compute/v2.1/servers/8a7b8f4c-0c11-406f-bed6-b4fd18e3c304/os-volume_attachments/9de4c0fd-b9a7-40d2-b857-8cc654a6f15a => generated 0 bytes in 508 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 10:58:21.650816 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-1439e8ed-525e-49d8-bf83-29b435db7051 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:21.653251 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-1439e8ed-525e-49d8-bf83-29b435db7051 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: 8a7b8f4c-0c11-406f-bed6-b4fd18e3c304] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:21.659557 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-1439e8ed-525e-49d8-bf83-29b435db7051 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:21.659995 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-1439e8ed-525e-49d8-bf83-29b435db7051 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:21.660764 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-1439e8ed-525e-49d8-bf83-29b435db7051 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:21.661190 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-1439e8ed-525e-49d8-bf83-29b435db7051 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:21.691889 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-1439e8ed-525e-49d8-bf83-29b435db7051 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "GET /compute/v2.1/servers/8a7b8f4c-0c11-406f-bed6-b4fd18e3c304/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044944 Aug 02 10:58:21.692729 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 222/438] 10.222.0.115 () {58 vars in 1307 bytes} [Tue Aug 2 10:58:21 2022] GET /compute/v2.1/servers/8a7b8f4c-0c11-406f-bed6-b4fd18e3c304/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:58:22.633727 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-e2e6776b-0a4e-4c59-8de5-0563fd1a082c tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:22.634458 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-e2e6776b-0a4e-4c59-8de5-0563fd1a082c tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: e7deeb40-9fc3-40f8-b564-192fe68fa113] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:22.641127 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-e2e6776b-0a4e-4c59-8de5-0563fd1a082c tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:22.644010 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-e2e6776b-0a4e-4c59-8de5-0563fd1a082c tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:22.644010 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-e2e6776b-0a4e-4c59-8de5-0563fd1a082c tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:22.644010 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-e2e6776b-0a4e-4c59-8de5-0563fd1a082c tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:22.704210 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-8d2f2bdf-7393-49d2-bff5-c8156f85cd84 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:22.706426 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-8d2f2bdf-7393-49d2-bff5-c8156f85cd84 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: 8a7b8f4c-0c11-406f-bed6-b4fd18e3c304] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:22.713593 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-8d2f2bdf-7393-49d2-bff5-c8156f85cd84 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:22.718476 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-8d2f2bdf-7393-49d2-bff5-c8156f85cd84 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:22.718476 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-8d2f2bdf-7393-49d2-bff5-c8156f85cd84 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:22.718476 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-8d2f2bdf-7393-49d2-bff5-c8156f85cd84 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:22.746815 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-8d2f2bdf-7393-49d2-bff5-c8156f85cd84 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "GET /compute/v2.1/servers/8a7b8f4c-0c11-406f-bed6-b4fd18e3c304/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046620 Aug 02 10:58:22.747638 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 223/439] 10.222.0.115 () {58 vars in 1307 bytes} [Tue Aug 2 10:58:22 2022] GET /compute/v2.1/servers/8a7b8f4c-0c11-406f-bed6-b4fd18e3c304/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:58:23.145081 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-e2e6776b-0a4e-4c59-8de5-0563fd1a082c tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:23.154538 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-e2e6776b-0a4e-4c59-8de5-0563fd1a082c tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/e7deeb40-9fc3-40f8-b564-192fe68fa113" status: 200 len: 1513 microversion: 2.1 time: 0.525414 Aug 02 10:58:23.155721 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 217/440] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:58:22 2022] GET /compute/v2.1/servers/e7deeb40-9fc3-40f8-b564-192fe68fa113 => generated 1513 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:58:23.603566 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [req-63b09350-e0b3-4bea-8ac6-a10045f7b493 req-4f041223-f5ff-4829-8a81-1dd3942b62fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "254a6894-dcb1-4909-a24e-a3a9bf701a83", "tag": "950f72fe-d9c4-4546-b649-bf02fe995cd8"}]} {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:58:23.613278 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [req-63b09350-e0b3-4bea-8ac6-a10045f7b493 req-4f041223-f5ff-4829-8a81-1dd3942b62fc service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:23.613730 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [req-63b09350-e0b3-4bea-8ac6-a10045f7b493 req-4f041223-f5ff-4829-8a81-1dd3942b62fc service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:23.625543 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.compute.server_external_events [req-63b09350-e0b3-4bea-8ac6-a10045f7b493 req-4f041223-f5ff-4829-8a81-1dd3942b62fc service nova] Creating event network-changed:950f72fe-d9c4-4546-b649-bf02fe995cd8 for instance 254a6894-dcb1-4909-a24e-a3a9bf701a83 on hv-cinder-85031 Aug 02 10:58:23.630999 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [req-63b09350-e0b3-4bea-8ac6-a10045f7b493 req-4f041223-f5ff-4829-8a81-1dd3942b62fc service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031243 Aug 02 10:58:23.631636 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 224/441] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Aug 2 10:58:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:58:23.759452 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-f6056d0d-554a-4127-9374-eff2c74cfcc4 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:23.762330 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-f6056d0d-554a-4127-9374-eff2c74cfcc4 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: 8a7b8f4c-0c11-406f-bed6-b4fd18e3c304] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:23.768823 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-f6056d0d-554a-4127-9374-eff2c74cfcc4 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:23.769270 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-f6056d0d-554a-4127-9374-eff2c74cfcc4 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:23.770041 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-f6056d0d-554a-4127-9374-eff2c74cfcc4 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:23.770478 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-f6056d0d-554a-4127-9374-eff2c74cfcc4 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:23.802540 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-f6056d0d-554a-4127-9374-eff2c74cfcc4 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "GET /compute/v2.1/servers/8a7b8f4c-0c11-406f-bed6-b4fd18e3c304/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047151 Aug 02 10:58:23.803125 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 218/442] 10.222.0.115 () {58 vars in 1307 bytes} [Tue Aug 2 10:58:23 2022] GET /compute/v2.1/servers/8a7b8f4c-0c11-406f-bed6-b4fd18e3c304/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:58:24.178923 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-c51b5d66-2b21-485c-8c44-a47d753eca01 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:24.179660 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-c51b5d66-2b21-485c-8c44-a47d753eca01 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: e7deeb40-9fc3-40f8-b564-192fe68fa113] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:24.186697 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-c51b5d66-2b21-485c-8c44-a47d753eca01 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:24.187198 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-c51b5d66-2b21-485c-8c44-a47d753eca01 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:24.188098 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-c51b5d66-2b21-485c-8c44-a47d753eca01 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:24.188532 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-c51b5d66-2b21-485c-8c44-a47d753eca01 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:24.330204 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-c51b5d66-2b21-485c-8c44-a47d753eca01 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:24.338039 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-c51b5d66-2b21-485c-8c44-a47d753eca01 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/e7deeb40-9fc3-40f8-b564-192fe68fa113" status: 200 len: 1519 microversion: 2.1 time: 0.164613 Aug 02 10:58:24.338619 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 225/443] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:58:24 2022] GET /compute/v2.1/servers/e7deeb40-9fc3-40f8-b564-192fe68fa113 => generated 1519 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:58:24.814587 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-69c4b255-ea0e-49d0-b857-2958134b5634 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:24.816882 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-69c4b255-ea0e-49d0-b857-2958134b5634 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: 8a7b8f4c-0c11-406f-bed6-b4fd18e3c304] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:24.819506 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG dbcounter [-] [129952] Writing DB stats nova_api:SELECT=86 {{(pid=129952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:58:24.824665 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-69c4b255-ea0e-49d0-b857-2958134b5634 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:24.825119 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-69c4b255-ea0e-49d0-b857-2958134b5634 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:24.825943 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-69c4b255-ea0e-49d0-b857-2958134b5634 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:24.826375 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-69c4b255-ea0e-49d0-b857-2958134b5634 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:24.859343 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-69c4b255-ea0e-49d0-b857-2958134b5634 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "GET /compute/v2.1/servers/8a7b8f4c-0c11-406f-bed6-b4fd18e3c304/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048661 Aug 02 10:58:24.859916 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 219/444] 10.222.0.115 () {58 vars in 1307 bytes} [Tue Aug 2 10:58:24 2022] GET /compute/v2.1/servers/8a7b8f4c-0c11-406f-bed6-b4fd18e3c304/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:58:25.871588 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-b99dd67d-b163-4efb-80e5-e3743cb3cfca tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:25.873867 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-b99dd67d-b163-4efb-80e5-e3743cb3cfca tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: 8a7b8f4c-0c11-406f-bed6-b4fd18e3c304] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:25.880534 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-b99dd67d-b163-4efb-80e5-e3743cb3cfca tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:25.880991 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-b99dd67d-b163-4efb-80e5-e3743cb3cfca tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:25.881754 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-b99dd67d-b163-4efb-80e5-e3743cb3cfca tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:25.882191 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-b99dd67d-b163-4efb-80e5-e3743cb3cfca tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:25.901854 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG dbcounter [-] [129953] Writing DB stats nova_cell1:SELECT=100 {{(pid=129953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:58:25.914848 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-b99dd67d-b163-4efb-80e5-e3743cb3cfca tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "GET /compute/v2.1/servers/8a7b8f4c-0c11-406f-bed6-b4fd18e3c304/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047989 Aug 02 10:58:25.915468 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 226/445] 10.222.0.115 () {58 vars in 1307 bytes} [Tue Aug 2 10:58:25 2022] GET /compute/v2.1/servers/8a7b8f4c-0c11-406f-bed6-b4fd18e3c304/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 10:58:25.978199 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-bc4236a6-5965-41f1-a606-97b5c4d91e0d tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:25.979334 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-bc4236a6-5965-41f1-a606-97b5c4d91e0d tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: 8a7b8f4c-0c11-406f-bed6-b4fd18e3c304] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:25.986206 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-bc4236a6-5965-41f1-a606-97b5c4d91e0d tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:25.986663 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-bc4236a6-5965-41f1-a606-97b5c4d91e0d tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:25.987458 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-bc4236a6-5965-41f1-a606-97b5c4d91e0d tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:25.988059 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-bc4236a6-5965-41f1-a606-97b5c4d91e0d tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:25.992086 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG dbcounter [-] [129952] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=129952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:58:26.014752 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-bc4236a6-5965-41f1-a606-97b5c4d91e0d tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: 8a7b8f4c-0c11-406f-bed6-b4fd18e3c304] Going to try to terminate instance {{(pid=129952) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 10:58:26.028410 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-e102e2b0-d3d9-42b8-895d-bfe365318232 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Action: 'create', calling method: .version_select at 0x7f7c4e656940>, body: {"keypair": {"name": "tempest-keypair-1403777949", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEEWQQdyFIKwGv+Jcodz4I3XAUtsj9OpPZCpmQKdjuzW7T1n/YDC0F2upEobYamvQuT0zy98ZOnlM2EiWEEN19QBR3esBOGMw3fsLL9oCqScDtWwlw1fg3HkR53XSk7l/w=="}} {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:58:26.045148 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.quota [None req-e102e2b0-d3d9-42b8-895d-bfe365318232 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Getting quotas for project 0d99d3fd13df429a8ee8a7cb7780adb5. Resources: {'key_pairs'} {{(pid=129953) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 10:58:26.049138 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.quota [None req-e102e2b0-d3d9-42b8-895d-bfe365318232 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Getting quotas for user 3057a53debc34c829372c03567e1119d and project 0d99d3fd13df429a8ee8a7cb7780adb5. Resources: {'key_pairs'} {{(pid=129953) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 10:58:26.173664 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-e102e2b0-d3d9-42b8-895d-bfe365318232 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.149595 Aug 02 10:58:26.174274 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 227/446] 10.222.0.115 () {60 vars in 1164 bytes} [Tue Aug 2 10:58:26 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:58:26.378396 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-bc4236a6-5965-41f1-a606-97b5c4d91e0d tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "DELETE /compute/v2.1/servers/8a7b8f4c-0c11-406f-bed6-b4fd18e3c304" status: 204 len: 0 microversion: 2.1 time: 0.404140 Aug 02 10:58:26.378987 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 220/447] 10.222.0.115 () {58 vars in 1244 bytes} [Tue Aug 2 10:58:25 2022] DELETE /compute/v2.1/servers/8a7b8f4c-0c11-406f-bed6-b4fd18e3c304 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 10:58:26.387738 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-536328f2-0144-4572-801e-d0d5bc153d4d tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:26.388729 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-536328f2-0144-4572-801e-d0d5bc153d4d tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: 8a7b8f4c-0c11-406f-bed6-b4fd18e3c304] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:26.394349 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-536328f2-0144-4572-801e-d0d5bc153d4d tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:26.394782 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-536328f2-0144-4572-801e-d0d5bc153d4d tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:26.395555 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-536328f2-0144-4572-801e-d0d5bc153d4d tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:26.395982 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-536328f2-0144-4572-801e-d0d5bc153d4d tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:26.533780 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-536328f2-0144-4572-801e-d0d5bc153d4d tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bc14ada1564911b2f0a698aef3f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a4a0cf1852449e8bfc59ddb5a902c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:26.541416 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-536328f2-0144-4572-801e-d0d5bc153d4d tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "GET /compute/v2.1/servers/8a7b8f4c-0c11-406f-bed6-b4fd18e3c304" status: 200 len: 1687 microversion: 2.1 time: 0.158142 Aug 02 10:58:26.542305 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 228/448] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:58:26 2022] GET /compute/v2.1/servers/8a7b8f4c-0c11-406f-bed6-b4fd18e3c304 => generated 1687 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:58:27.565134 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-ef2a9420-3460-4791-a5ef-ece4e8878677 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:27.566161 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-ef2a9420-3460-4791-a5ef-ece4e8878677 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: 8a7b8f4c-0c11-406f-bed6-b4fd18e3c304] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:27.573616 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-ef2a9420-3460-4791-a5ef-ece4e8878677 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:27.584477 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-ef2a9420-3460-4791-a5ef-ece4e8878677 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:27.584477 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-ef2a9420-3460-4791-a5ef-ece4e8878677 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:27.584477 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-ef2a9420-3460-4791-a5ef-ece4e8878677 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:27.710211 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-ef2a9420-3460-4791-a5ef-ece4e8878677 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bc14ada1564911b2f0a698aef3f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a4a0cf1852449e8bfc59ddb5a902c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:27.721915 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-ef2a9420-3460-4791-a5ef-ece4e8878677 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "GET /compute/v2.1/servers/8a7b8f4c-0c11-406f-bed6-b4fd18e3c304" status: 200 len: 1687 microversion: 2.1 time: 0.157857 Aug 02 10:58:27.721915 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 221/449] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:58:27 2022] GET /compute/v2.1/servers/8a7b8f4c-0c11-406f-bed6-b4fd18e3c304 => generated 1687 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:58:28.559074 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-fa85ac2b-50bf-47c1-8261-3df98df40886 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1042478954", "imageRef": "aa0a7b8c-0dd6-4803-8767-cb8c2d05fdd4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e214b1a0-f6ae-4d74-8b26-44991d3744df"}], "security_groups": [{"name": "tempest-securitygroup--1346308515"}], "key_name": "tempest-keypair-1403777949", "user_data": "}} {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:58:28.665262 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.network.neutron [None req-fa85ac2b-50bf-47c1-8261-3df98df40886 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] validate_networks() for [('e214b1a0-f6ae-4d74-8b26-44991d3744df', None, None, None, None, None)] {{(pid=129953) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 10:58:28.740941 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-369490a9-74bd-4cae-b931-4ff064ca31f8 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:28.742350 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-369490a9-74bd-4cae-b931-4ff064ca31f8 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: 8a7b8f4c-0c11-406f-bed6-b4fd18e3c304] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:28.749063 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-369490a9-74bd-4cae-b931-4ff064ca31f8 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:28.749517 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-369490a9-74bd-4cae-b931-4ff064ca31f8 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:28.750307 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-369490a9-74bd-4cae-b931-4ff064ca31f8 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:28.750942 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-369490a9-74bd-4cae-b931-4ff064ca31f8 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:28.955287 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-369490a9-74bd-4cae-b931-4ff064ca31f8 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bc14ada1564911b2f0a698aef3f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a4a0cf1852449e8bfc59ddb5a902c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:28.965447 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-369490a9-74bd-4cae-b931-4ff064ca31f8 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "GET /compute/v2.1/servers/8a7b8f4c-0c11-406f-bed6-b4fd18e3c304" status: 200 len: 1687 microversion: 2.1 time: 0.227549 Aug 02 10:58:28.972080 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 222/450] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:58:28 2022] GET /compute/v2.1/servers/8a7b8f4c-0c11-406f-bed6-b4fd18e3c304 => generated 1687 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:58:29.132918 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.virt.hardware [None req-fa85ac2b-50bf-47c1-8261-3df98df40886 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Flavor limits 0:0:0 {{(pid=129953) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 10:58:29.133416 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.virt.hardware [None req-fa85ac2b-50bf-47c1-8261-3df98df40886 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Image limits 0:0:0 {{(pid=129953) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 10:58:29.133968 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.virt.hardware [None req-fa85ac2b-50bf-47c1-8261-3df98df40886 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Flavor pref 0:0:0 {{(pid=129953) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 10:58:29.134450 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.virt.hardware [None req-fa85ac2b-50bf-47c1-8261-3df98df40886 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Image pref 0:0:0 {{(pid=129953) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 10:58:29.135082 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.virt.hardware [None req-fa85ac2b-50bf-47c1-8261-3df98df40886 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129953) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 10:58:29.144792 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-fa85ac2b-50bf-47c1-8261-3df98df40886 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:29.145338 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-fa85ac2b-50bf-47c1-8261-3df98df40886 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:29.146155 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-fa85ac2b-50bf-47c1-8261-3df98df40886 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:29.146598 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-fa85ac2b-50bf-47c1-8261-3df98df40886 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:29.166124 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.quota [None req-fa85ac2b-50bf-47c1-8261-3df98df40886 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Getting quotas for project 0d99d3fd13df429a8ee8a7cb7780adb5. Resources: {'instances', 'cores', 'ram'} {{(pid=129953) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 10:58:29.170728 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.quota [None req-fa85ac2b-50bf-47c1-8261-3df98df40886 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Getting quotas for user 3057a53debc34c829372c03567e1119d and project 0d99d3fd13df429a8ee8a7cb7780adb5. Resources: {'instances', 'cores', 'ram'} {{(pid=129953) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 10:58:29.182784 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-fa85ac2b-50bf-47c1-8261-3df98df40886 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Going to run 1 instances... {{(pid=129953) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 10:58:29.185367 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-fa85ac2b-50bf-47c1-8261-3df98df40886 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aa0a7b8c-0dd6-4803-8767-cb8c2d05fdd4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129953) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 10:58:29.325300 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-fa85ac2b-50bf-47c1-8261-3df98df40886 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "POST /compute/v2.1/servers" status: 202 len: 411 microversion: 2.1 time: 0.771113 Aug 02 10:58:29.326168 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 229/451] 10.222.0.115 () {60 vars in 1152 bytes} [Tue Aug 2 10:58:28 2022] POST /compute/v2.1/servers => generated 411 bytes in 773 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 02 10:58:29.337213 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-46a3b2d7-b2f4-49cc-b5db-c5e3c25a2fe0 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:29.337859 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-46a3b2d7-b2f4-49cc-b5db-c5e3c25a2fe0 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:29.393364 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-46a3b2d7-b2f4-49cc-b5db-c5e3c25a2fe0 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:29.400140 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-46a3b2d7-b2f4-49cc-b5db-c5e3c25a2fe0 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a" status: 200 len: 1250 microversion: 2.1 time: 0.066987 Aug 02 10:58:29.400716 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 223/452] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:58:29 2022] GET /compute/v2.1/servers/8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a => generated 1250 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:58:29.761103 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [req-56961fe6-7932-4456-acd1-7b7462e680f6 req-29ebd9fb-cb74-4eae-91cb-9a6d187fc50b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a7b8f4c-0c11-406f-bed6-b4fd18e3c304", "name": "network-vif-deleted", "tag": "a726c1ca-b762-4699-8bde-774b6f63a9dc"}]} {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:58:29.773382 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [req-56961fe6-7932-4456-acd1-7b7462e680f6 req-29ebd9fb-cb74-4eae-91cb-9a6d187fc50b service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:29.774105 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [req-56961fe6-7932-4456-acd1-7b7462e680f6 req-29ebd9fb-cb74-4eae-91cb-9a6d187fc50b service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:29.785834 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.compute.server_external_events [req-56961fe6-7932-4456-acd1-7b7462e680f6 req-29ebd9fb-cb74-4eae-91cb-9a6d187fc50b service nova] Creating event network-vif-deleted:a726c1ca-b762-4699-8bde-774b6f63a9dc for instance 8a7b8f4c-0c11-406f-bed6-b4fd18e3c304 on hv-cinder-85031 Aug 02 10:58:29.791039 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [req-56961fe6-7932-4456-acd1-7b7462e680f6 req-29ebd9fb-cb74-4eae-91cb-9a6d187fc50b service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034740 Aug 02 10:58:29.791837 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 230/453] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Aug 2 10:58:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:58:29.986702 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-4d0081df-c8cf-4883-b602-4441ea99b036 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:29.988100 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-4d0081df-c8cf-4883-b602-4441ea99b036 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: 8a7b8f4c-0c11-406f-bed6-b4fd18e3c304] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:29.995139 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-4d0081df-c8cf-4883-b602-4441ea99b036 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:29.995670 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-4d0081df-c8cf-4883-b602-4441ea99b036 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:29.997318 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-4d0081df-c8cf-4883-b602-4441ea99b036 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:29.998259 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-4d0081df-c8cf-4883-b602-4441ea99b036 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:30.067240 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-4d0081df-c8cf-4883-b602-4441ea99b036 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bc14ada1564911b2f0a698aef3f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a4a0cf1852449e8bfc59ddb5a902c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:30.076947 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-4d0081df-c8cf-4883-b602-4441ea99b036 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "GET /compute/v2.1/servers/8a7b8f4c-0c11-406f-bed6-b4fd18e3c304" status: 200 len: 1330 microversion: 2.1 time: 0.094108 Aug 02 10:58:30.077727 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 224/454] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:58:29 2022] GET /compute/v2.1/servers/8a7b8f4c-0c11-406f-bed6-b4fd18e3c304 => generated 1330 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:58:30.422958 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-12949fa0-ab51-4b79-aac2-863dcf6381a5 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:30.423503 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-12949fa0-ab51-4b79-aac2-863dcf6381a5 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:30.429883 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-12949fa0-ab51-4b79-aac2-863dcf6381a5 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:30.430341 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-12949fa0-ab51-4b79-aac2-863dcf6381a5 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:30.431204 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-12949fa0-ab51-4b79-aac2-863dcf6381a5 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:30.431648 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-12949fa0-ab51-4b79-aac2-863dcf6381a5 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:30.498427 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-12949fa0-ab51-4b79-aac2-863dcf6381a5 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:30.507658 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-12949fa0-ab51-4b79-aac2-863dcf6381a5 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a" status: 200 len: 1254 microversion: 2.1 time: 0.089489 Aug 02 10:58:30.509763 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 231/455] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:58:30 2022] GET /compute/v2.1/servers/8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a => generated 1254 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:58:31.097764 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-9e91af5f-920c-47b0-b6da-cb9e263a747c tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:31.098382 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-9e91af5f-920c-47b0-b6da-cb9e263a747c tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: 8a7b8f4c-0c11-406f-bed6-b4fd18e3c304] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:31.105701 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-9e91af5f-920c-47b0-b6da-cb9e263a747c tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:31.106155 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-9e91af5f-920c-47b0-b6da-cb9e263a747c tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:31.106925 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-9e91af5f-920c-47b0-b6da-cb9e263a747c tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:31.107381 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-9e91af5f-920c-47b0-b6da-cb9e263a747c tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:31.120753 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.wsgi [None req-9e91af5f-920c-47b0-b6da-cb9e263a747c tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] HTTP exception thrown: Instance 8a7b8f4c-0c11-406f-bed6-b4fd18e3c304 could not be found. Aug 02 10:58:31.122426 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-9e91af5f-920c-47b0-b6da-cb9e263a747c tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Request method failure captured: Aug 02 10:58:31.122426 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: request: GET /compute/v2.1/servers/8a7b8f4c-0c11-406f-bed6-b4fd18e3c304 HTTP/1.1 Aug 02 10:58:31.122426 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Accept: application/json Aug 02 10:58:31.122426 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Accept-Encoding: identity Aug 02 10:58:31.122426 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Connection: close Aug 02 10:58:31.122426 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Content-Length: 0 Aug 02 10:58:31.122426 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Content-Type: application/json Aug 02 10:58:31.122426 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Host: 10.222.0.115 Aug 02 10:58:31.122426 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Openstack-System-Scope: None Aug 02 10:58:31.122426 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: User-Agent: python-urllib3/1.26.10 Aug 02 10:58:31.122426 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Auth-Token: gAAAAABi6QKMm0zWjcrgGxsKGjmUpSACSDsl300OSZbmfbKI8W7YRiqQlsT7G2Yz8bTCtqeY5P5LouAzxFYTu1e6mP7SLmcSkT2w0SAqH9Ev0MtEiqJ7hFJOgCTtlSAmMKZk3KczE4deWY0afZWtzWq9Z6D1UUJ57x6ix6Lv8M0Q8lVdVaQlJYs Aug 02 10:58:31.122426 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Domain-Id: None Aug 02 10:58:31.122426 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Domain-Name: None Aug 02 10:58:31.122426 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Identity-Status: Confirmed Aug 02 10:58:31.122426 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Is-Admin-Project: True Aug 02 10:58:31.122426 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Project-Domain-Id: default Aug 02 10:58:31.122426 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Project-Domain-Name: Default Aug 02 10:58:31.122426 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Project-Id: 89a4a0cf1852449e8bfc59ddb5a902c1 Aug 02 10:58:31.122426 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Project-Name: tempest-AttachVolumeNegativeTest-1965368294 Aug 02 10:58:31.122426 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Role: reader,member Aug 02 10:58:31.122426 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Roles: reader,member Aug 02 10:58:31.124080 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/89a4a0cf1852449e8bfc59ddb5a902c1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2/89a4a0cf1852449e8bfc59ddb5a902c1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/89a4a0cf1852449e8bfc59ddb5a902c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.115:8080", "publicURL": "http://10.222.0.115:8080/v1/AUTH_89a4a0cf1852449e8bfc59ddb5a902c1"}]}] Aug 02 10:58:31.124080 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Tenant: tempest-AttachVolumeNegativeTest-1965368294 Aug 02 10:58:31.124080 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Tenant-Id: 89a4a0cf1852449e8bfc59ddb5a902c1 Aug 02 10:58:31.124080 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1965368294 Aug 02 10:58:31.124080 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User: tempest-AttachVolumeNegativeTest-1965368294-project Aug 02 10:58:31.124080 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User-Domain-Id: default Aug 02 10:58:31.124080 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User-Domain-Name: Default Aug 02 10:58:31.124080 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User-Id: 53bc14ada1564911b2f0a698aef3f333 Aug 02 10:58:31.124080 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User-Name: tempest-AttachVolumeNegativeTest-1965368294-project Aug 02 10:58:31.124080 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: method: > Aug 02 10:58:31.124080 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: exception: Instance 8a7b8f4c-0c11-406f-bed6-b4fd18e3c304 could not be found. Aug 02 10:58:31.124080 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: action_args: {'id': '8a7b8f4c-0c11-406f-bed6-b4fd18e3c304'} Aug 02 10:58:31.125097 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:58:31.125097 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:58:31.125097 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 10:58:31.125097 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 10:58:31.125097 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 10:58:31.125097 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 10:58:31.125097 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 10:58:31.125097 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 10:58:31.125097 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 10:58:31.125097 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 10:58:31.125097 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a7b8f4c-0c11-406f-bed6-b4fd18e3c304 could not be found. Aug 02 10:58:31.125097 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 10:58:31.125097 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:58:31.125097 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 10:58:31.125097 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:58:31.125097 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:58:31.125097 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:58:31.125097 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:58:31.125097 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:58:31.125097 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:58:31.126713 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:58:31.126713 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 10:58:31.126713 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 10:58:31.126713 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 10:58:31.126713 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 10:58:31.126713 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 10:58:31.126713 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 10:58:31.126713 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a7b8f4c-0c11-406f-bed6-b4fd18e3c304 could not be found. Aug 02 10:58:31.126713 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 10:58:31.126713 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:58:31.126713 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 10:58:31.126713 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:58:31.126713 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:58:31.126713 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:58:31.126713 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:58:31.126713 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:58:31.126713 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a7b8f4c-0c11-406f-bed6-b4fd18e3c304 could not be found. Aug 02 10:58:31.126713 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 10:58:31.128089 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-9e91af5f-920c-47b0-b6da-cb9e263a747c tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Returning 404 to user: Instance 8a7b8f4c-0c11-406f-bed6-b4fd18e3c304 could not be found. {{(pid=129952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:58:31.128089 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-9e91af5f-920c-47b0-b6da-cb9e263a747c tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "GET /compute/v2.1/servers/8a7b8f4c-0c11-406f-bed6-b4fd18e3c304" status: 404 len: 111 microversion: 2.1 time: 0.029977 Aug 02 10:58:31.128089 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 225/456] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:58:31 2022] GET /compute/v2.1/servers/8a7b8f4c-0c11-406f-bed6-b4fd18e3c304 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 10:58:31.132916 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-c1350d68-5101-4b6e-becb-31ea40bc4ddb tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Calling method '.version_select at 0x7f7c4e7af550>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:31.261008 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-c1350d68-5101-4b6e-becb-31ea40bc4ddb tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-955711744" status: 202 len: 0 microversion: 2.1 time: 0.131779 Aug 02 10:58:31.262085 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 232/457] 10.222.0.115 () {58 vars in 1223 bytes} [Tue Aug 2 10:58:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-955711744 => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 10:58:31.532967 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-c301590d-b21c-47ee-8dfe-940d879fc590 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:31.533769 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-c301590d-b21c-47ee-8dfe-940d879fc590 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:31.540514 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-c301590d-b21c-47ee-8dfe-940d879fc590 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:31.541052 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-c301590d-b21c-47ee-8dfe-940d879fc590 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:31.541965 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-c301590d-b21c-47ee-8dfe-940d879fc590 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:31.542512 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-c301590d-b21c-47ee-8dfe-940d879fc590 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:31.630593 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-c301590d-b21c-47ee-8dfe-940d879fc590 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:31.638770 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-c301590d-b21c-47ee-8dfe-940d879fc590 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a" status: 200 len: 1302 microversion: 2.1 time: 0.112733 Aug 02 10:58:31.639537 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 226/458] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:58:31 2022] GET /compute/v2.1/servers/8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a => generated 1302 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:58:32.081766 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-7c7dea7f-5a6b-4fca-99e3-c1a9eae0f6ea tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Action: 'create', calling method: .version_select at 0x7f7c4e6a54c0>, body: {"keypair": {"name": "tempest-keypair-210460134", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLJ3bgtWPVM5SeoGIeaK684PNtP5ixWlj7+0TYqNE6ub3vo0j+xEkllmWrrhBY/h1pl5R2x2U8Uj7IItauBPMgBqZFeQ6SpiXGg2sIqx9EWw/8PqoxAAsiz5PLwtUAEtZw=="}} {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:58:32.099249 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.quota [None req-7c7dea7f-5a6b-4fca-99e3-c1a9eae0f6ea tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Getting quotas for project 89a4a0cf1852449e8bfc59ddb5a902c1. Resources: {'key_pairs'} {{(pid=129953) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 10:58:32.103194 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.quota [None req-7c7dea7f-5a6b-4fca-99e3-c1a9eae0f6ea tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Getting quotas for user 53bc14ada1564911b2f0a698aef3f333 and project 89a4a0cf1852449e8bfc59ddb5a902c1. Resources: {'key_pairs'} {{(pid=129953) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 10:58:32.208490 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-7c7dea7f-5a6b-4fca-99e3-c1a9eae0f6ea tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.130929 Aug 02 10:58:32.209762 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 233/459] 10.222.0.115 () {60 vars in 1164 bytes} [Tue Aug 2 10:58:32 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:58:32.660667 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-e1e00183-1c3f-4b8c-8669-f333c5b8b1ff tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:32.661313 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-e1e00183-1c3f-4b8c-8669-f333c5b8b1ff tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:32.668431 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-e1e00183-1c3f-4b8c-8669-f333c5b8b1ff tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:32.668939 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-e1e00183-1c3f-4b8c-8669-f333c5b8b1ff tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:32.669673 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-e1e00183-1c3f-4b8c-8669-f333c5b8b1ff tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:32.670131 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-e1e00183-1c3f-4b8c-8669-f333c5b8b1ff tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:32.844778 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-e1e00183-1c3f-4b8c-8669-f333c5b8b1ff tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:32.861096 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-e1e00183-1c3f-4b8c-8669-f333c5b8b1ff tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a" status: 200 len: 1376 microversion: 2.1 time: 0.200347 Aug 02 10:58:32.861096 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 227/460] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:58:32 2022] GET /compute/v2.1/servers/8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a => generated 1376 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:58:33.621108 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [req-2f5987e2-cc02-4b99-a7b6-da2ff6ebe3dd req-782b4241-d540-4ecd-961f-811348e52a20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a", "tag": "83daf3e6-2460-4c6a-8114-303f93cdd38a"}]} {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:58:33.631132 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [req-2f5987e2-cc02-4b99-a7b6-da2ff6ebe3dd req-782b4241-d540-4ecd-961f-811348e52a20 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:33.631588 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [req-2f5987e2-cc02-4b99-a7b6-da2ff6ebe3dd req-782b4241-d540-4ecd-961f-811348e52a20 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:33.643608 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.compute.server_external_events [req-2f5987e2-cc02-4b99-a7b6-da2ff6ebe3dd req-782b4241-d540-4ecd-961f-811348e52a20 service nova] Creating event network-changed:83daf3e6-2460-4c6a-8114-303f93cdd38a for instance 8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a on hv-cinder-85031 Aug 02 10:58:33.648690 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [req-2f5987e2-cc02-4b99-a7b6-da2ff6ebe3dd req-782b4241-d540-4ecd-961f-811348e52a20 service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032043 Aug 02 10:58:33.652553 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 234/461] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Aug 2 10:58:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:58:33.878134 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-088c89f3-32d7-4b0f-aee5-17dc6143cc5b tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:33.878835 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-088c89f3-32d7-4b0f-aee5-17dc6143cc5b tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:33.885735 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-088c89f3-32d7-4b0f-aee5-17dc6143cc5b tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:33.886236 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-088c89f3-32d7-4b0f-aee5-17dc6143cc5b tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:33.887087 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-088c89f3-32d7-4b0f-aee5-17dc6143cc5b tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:33.887708 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-088c89f3-32d7-4b0f-aee5-17dc6143cc5b tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:34.111152 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-088c89f3-32d7-4b0f-aee5-17dc6143cc5b tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:34.119397 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-088c89f3-32d7-4b0f-aee5-17dc6143cc5b tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a" status: 200 len: 1376 microversion: 2.1 time: 0.245164 Aug 02 10:58:34.119970 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 228/462] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:58:33 2022] GET /compute/v2.1/servers/8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a => generated 1376 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:58:34.734271 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-1a7270f8-b24b-41e6-8957-9759cadbe8cd tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-729264314", "imageRef": "aa0a7b8c-0dd6-4803-8767-cb8c2d05fdd4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "aafffa4e-4cec-4281-b3a0-ebe26470b35c"}], "security_groups": [{"name": "tempest-securitygroup--607391898"}], "key_name": "tempest-keypair-210460134", "user_data": "}} {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:58:34.806650 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-486ed28d-8f15-493d-ae30-b1e82345a067 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:34.807161 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-486ed28d-8f15-493d-ae30-b1e82345a067 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] [instance: 3938932a-e778-4c0c-9ab0-78dc9082a48e] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:34.813315 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-486ed28d-8f15-493d-ae30-b1e82345a067 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:34.813987 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-486ed28d-8f15-493d-ae30-b1e82345a067 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:34.814748 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-486ed28d-8f15-493d-ae30-b1e82345a067 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:34.815207 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-486ed28d-8f15-493d-ae30-b1e82345a067 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:34.841529 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.network.neutron [None req-1a7270f8-b24b-41e6-8957-9759cadbe8cd tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] validate_networks() for [('aafffa4e-4cec-4281-b3a0-ebe26470b35c', None, None, None, None, None)] {{(pid=129953) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 10:58:34.898145 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.objects.instance [None req-486ed28d-8f15-493d-ae30-b1e82345a067 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lazy-loading 'services' on Instance uuid 3938932a-e778-4c0c-9ab0-78dc9082a48e {{(pid=129952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 10:58:35.104541 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-486ed28d-8f15-493d-ae30-b1e82345a067 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] 10.222.0.115 "DELETE /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e/os-volume_attachments/9e79746f-c0b3-4b2f-8c8f-59118274f943" status: 202 len: 0 microversion: 2.1 time: 0.301623 Aug 02 10:58:35.105417 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 229/463] 10.222.0.115 () {58 vars in 1421 bytes} [Tue Aug 2 10:58:34 2022] DELETE /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e/os-volume_attachments/9e79746f-c0b3-4b2f-8c8f-59118274f943 => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 02 10:58:35.142508 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-cc6df69a-894d-43cb-9705-a00186950ef2 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:35.143451 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-cc6df69a-894d-43cb-9705-a00186950ef2 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:35.150139 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-cc6df69a-894d-43cb-9705-a00186950ef2 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:35.150678 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-cc6df69a-894d-43cb-9705-a00186950ef2 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:35.152485 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-cc6df69a-894d-43cb-9705-a00186950ef2 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:35.152834 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-cc6df69a-894d-43cb-9705-a00186950ef2 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:35.268441 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.virt.hardware [None req-1a7270f8-b24b-41e6-8957-9759cadbe8cd tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Flavor limits 0:0:0 {{(pid=129953) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 10:58:35.268858 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.virt.hardware [None req-1a7270f8-b24b-41e6-8957-9759cadbe8cd tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Image limits 0:0:0 {{(pid=129953) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 10:58:35.269322 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.virt.hardware [None req-1a7270f8-b24b-41e6-8957-9759cadbe8cd tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Flavor pref 0:0:0 {{(pid=129953) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 10:58:35.269750 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.virt.hardware [None req-1a7270f8-b24b-41e6-8957-9759cadbe8cd tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Image pref 0:0:0 {{(pid=129953) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 10:58:35.270155 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.virt.hardware [None req-1a7270f8-b24b-41e6-8957-9759cadbe8cd tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129953) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 10:58:35.279421 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-1a7270f8-b24b-41e6-8957-9759cadbe8cd tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:35.279919 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-1a7270f8-b24b-41e6-8957-9759cadbe8cd tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:35.280719 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-1a7270f8-b24b-41e6-8957-9759cadbe8cd tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:35.281148 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-1a7270f8-b24b-41e6-8957-9759cadbe8cd tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:35.299032 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.quota [None req-1a7270f8-b24b-41e6-8957-9759cadbe8cd tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Getting quotas for project 89a4a0cf1852449e8bfc59ddb5a902c1. Resources: {'instances', 'cores', 'ram'} {{(pid=129953) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 10:58:35.303211 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.quota [None req-1a7270f8-b24b-41e6-8957-9759cadbe8cd tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Getting quotas for user 53bc14ada1564911b2f0a698aef3f333 and project 89a4a0cf1852449e8bfc59ddb5a902c1. Resources: {'instances', 'cores', 'ram'} {{(pid=129953) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 10:58:35.315304 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-cc6df69a-894d-43cb-9705-a00186950ef2 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:35.316382 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-1a7270f8-b24b-41e6-8957-9759cadbe8cd tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Going to run 1 instances... {{(pid=129953) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 10:58:35.318741 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-1a7270f8-b24b-41e6-8957-9759cadbe8cd tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: a780ca09-3975-44eb-9464-355460c10686] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aa0a7b8c-0dd6-4803-8767-cb8c2d05fdd4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129953) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 10:58:35.322831 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-cc6df69a-894d-43cb-9705-a00186950ef2 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a" status: 200 len: 1376 microversion: 2.1 time: 0.184679 Aug 02 10:58:35.323459 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 230/464] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:58:35 2022] GET /compute/v2.1/servers/8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a => generated 1376 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:58:35.459795 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-1a7270f8-b24b-41e6-8957-9759cadbe8cd tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.730777 Aug 02 10:58:35.460488 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 235/465] 10.222.0.115 () {60 vars in 1152 bytes} [Tue Aug 2 10:58:34 2022] POST /compute/v2.1/servers => generated 403 bytes in 732 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 02 10:58:35.472391 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-f879ca62-dbc8-4ed1-8ce5-37006cb04ff5 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:35.473001 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-f879ca62-dbc8-4ed1-8ce5-37006cb04ff5 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: a780ca09-3975-44eb-9464-355460c10686] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:35.528230 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-f879ca62-dbc8-4ed1-8ce5-37006cb04ff5 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bc14ada1564911b2f0a698aef3f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a4a0cf1852449e8bfc59ddb5a902c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:35.535248 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-f879ca62-dbc8-4ed1-8ce5-37006cb04ff5 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "GET /compute/v2.1/servers/a780ca09-3975-44eb-9464-355460c10686" status: 200 len: 1244 microversion: 2.1 time: 0.066672 Aug 02 10:58:35.535817 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 231/466] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:58:35 2022] GET /compute/v2.1/servers/a780ca09-3975-44eb-9464-355460c10686 => generated 1244 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:58:36.344803 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-b75e0bb6-e75a-489b-a007-37525a91e54b tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:36.345355 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-b75e0bb6-e75a-489b-a007-37525a91e54b tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:36.352523 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-b75e0bb6-e75a-489b-a007-37525a91e54b tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:36.352968 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-b75e0bb6-e75a-489b-a007-37525a91e54b tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:36.353733 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-b75e0bb6-e75a-489b-a007-37525a91e54b tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:36.354162 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-b75e0bb6-e75a-489b-a007-37525a91e54b tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:36.487286 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-b75e0bb6-e75a-489b-a007-37525a91e54b tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:36.494876 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-b75e0bb6-e75a-489b-a007-37525a91e54b tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a" status: 200 len: 1376 microversion: 2.1 time: 0.155352 Aug 02 10:58:36.497918 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 236/467] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:58:36 2022] GET /compute/v2.1/servers/8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a => generated 1376 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:58:36.556361 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-8d63fe9d-261a-4bab-a5a9-38491e7f18ef tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:36.557092 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-8d63fe9d-261a-4bab-a5a9-38491e7f18ef tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: a780ca09-3975-44eb-9464-355460c10686] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:36.564175 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-8d63fe9d-261a-4bab-a5a9-38491e7f18ef tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:36.564626 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-8d63fe9d-261a-4bab-a5a9-38491e7f18ef tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:36.565384 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-8d63fe9d-261a-4bab-a5a9-38491e7f18ef tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:36.566053 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-8d63fe9d-261a-4bab-a5a9-38491e7f18ef tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:36.631362 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-8d63fe9d-261a-4bab-a5a9-38491e7f18ef tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bc14ada1564911b2f0a698aef3f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a4a0cf1852449e8bfc59ddb5a902c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:36.639196 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-8d63fe9d-261a-4bab-a5a9-38491e7f18ef tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "GET /compute/v2.1/servers/a780ca09-3975-44eb-9464-355460c10686" status: 200 len: 1248 microversion: 2.1 time: 0.086632 Aug 02 10:58:36.639790 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 232/468] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:58:36 2022] GET /compute/v2.1/servers/a780ca09-3975-44eb-9464-355460c10686 => generated 1248 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:58:37.286536 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-9d99f762-1220-4abe-87b5-7a0900ee505e tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:58:37.293233 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-9d99f762-1220-4abe-87b5-7a0900ee505e tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:37.293785 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-9d99f762-1220-4abe-87b5-7a0900ee505e tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:37.359329 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-9d99f762-1220-4abe-87b5-7a0900ee505e tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] [instance: 3938932a-e778-4c0c-9ab0-78dc9082a48e] Going to try to stop instance {{(pid=129953) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 02 10:58:37.516040 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-38755d3b-efec-4bd1-8934-e647e065b204 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:37.516812 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-38755d3b-efec-4bd1-8934-e647e065b204 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:37.522964 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-38755d3b-efec-4bd1-8934-e647e065b204 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:37.523454 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-38755d3b-efec-4bd1-8934-e647e065b204 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:37.524235 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-38755d3b-efec-4bd1-8934-e647e065b204 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:37.524695 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-38755d3b-efec-4bd1-8934-e647e065b204 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:37.565888 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-9d99f762-1220-4abe-87b5-7a0900ee505e tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] 10.222.0.115 "POST /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e/action" status: 202 len: 0 microversion: 2.1 time: 0.283120 Aug 02 10:58:37.566545 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 237/469] 10.222.0.115 () {60 vars in 1283 bytes} [Tue Aug 2 10:58:37 2022] POST /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e/action => generated 0 bytes in 285 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 10:58:37.576367 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-44711e84-4556-422f-a6f7-3ce952b29e6e tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:37.576367 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-44711e84-4556-422f-a6f7-3ce952b29e6e tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] [instance: 3938932a-e778-4c0c-9ab0-78dc9082a48e] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:37.582267 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-44711e84-4556-422f-a6f7-3ce952b29e6e tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:37.582720 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-44711e84-4556-422f-a6f7-3ce952b29e6e tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:37.583549 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-44711e84-4556-422f-a6f7-3ce952b29e6e tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:37.583989 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-44711e84-4556-422f-a6f7-3ce952b29e6e tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:37.728674 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-38755d3b-efec-4bd1-8934-e647e065b204 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:37.737208 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-38755d3b-efec-4bd1-8934-e647e065b204 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a" status: 200 len: 1376 microversion: 2.1 time: 0.225450 Aug 02 10:58:37.737792 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 233/470] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:58:37 2022] GET /compute/v2.1/servers/8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a => generated 1376 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:58:37.742468 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-111c888a-fda5-46ec-87a6-38d0c4804b17 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:37.743323 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-111c888a-fda5-46ec-87a6-38d0c4804b17 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: a780ca09-3975-44eb-9464-355460c10686] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:37.761283 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-111c888a-fda5-46ec-87a6-38d0c4804b17 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:37.764097 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-44711e84-4556-422f-a6f7-3ce952b29e6e tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f41f17f5154e01a699043edc350cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e92110a1545f1b84644b8971bb6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:37.771463 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-111c888a-fda5-46ec-87a6-38d0c4804b17 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:37.772118 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-44711e84-4556-422f-a6f7-3ce952b29e6e tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] 10.222.0.115 "GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e" status: 200 len: 1679 microversion: 2.1 time: 0.200953 Aug 02 10:58:37.772570 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-111c888a-fda5-46ec-87a6-38d0c4804b17 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:37.772887 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 238/471] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:58:37 2022] GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e => generated 1679 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:58:37.777595 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-111c888a-fda5-46ec-87a6-38d0c4804b17 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:37.841435 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-111c888a-fda5-46ec-87a6-38d0c4804b17 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bc14ada1564911b2f0a698aef3f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a4a0cf1852449e8bfc59ddb5a902c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:37.850541 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-111c888a-fda5-46ec-87a6-38d0c4804b17 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "GET /compute/v2.1/servers/a780ca09-3975-44eb-9464-355460c10686" status: 200 len: 1304 microversion: 2.1 time: 0.111532 Aug 02 10:58:37.851151 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 234/472] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:58:37 2022] GET /compute/v2.1/servers/a780ca09-3975-44eb-9464-355460c10686 => generated 1304 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:58:38.757916 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-6886f809-265d-4a41-9384-fc32d9932ae2 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:38.758523 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-6886f809-265d-4a41-9384-fc32d9932ae2 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:38.765860 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-6886f809-265d-4a41-9384-fc32d9932ae2 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:38.766311 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-6886f809-265d-4a41-9384-fc32d9932ae2 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:38.772461 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-6886f809-265d-4a41-9384-fc32d9932ae2 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:38.772461 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-6886f809-265d-4a41-9384-fc32d9932ae2 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:38.796407 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-e7d2ae15-02eb-4716-a69d-f309e073acfe tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:38.798779 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-e7d2ae15-02eb-4716-a69d-f309e073acfe tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] [instance: 3938932a-e778-4c0c-9ab0-78dc9082a48e] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:38.806190 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-e7d2ae15-02eb-4716-a69d-f309e073acfe tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:38.806640 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-e7d2ae15-02eb-4716-a69d-f309e073acfe tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:38.807799 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-e7d2ae15-02eb-4716-a69d-f309e073acfe tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:38.808498 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-e7d2ae15-02eb-4716-a69d-f309e073acfe tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:38.990171 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-6886f809-265d-4a41-9384-fc32d9932ae2 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:38.999350 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-6886f809-265d-4a41-9384-fc32d9932ae2 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a" status: 200 len: 1376 microversion: 2.1 time: 0.245238 Aug 02 10:58:38.999941 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 239/473] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:58:38 2022] GET /compute/v2.1/servers/8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a => generated 1376 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:58:39.004978 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-4e97dd10-842f-456f-b372-5975532df4d7 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:39.005621 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-4e97dd10-842f-456f-b372-5975532df4d7 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: a780ca09-3975-44eb-9464-355460c10686] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:39.006305 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-e7d2ae15-02eb-4716-a69d-f309e073acfe tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f41f17f5154e01a699043edc350cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e92110a1545f1b84644b8971bb6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:39.011762 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-4e97dd10-842f-456f-b372-5975532df4d7 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:39.012476 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-4e97dd10-842f-456f-b372-5975532df4d7 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:39.014017 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-4e97dd10-842f-456f-b372-5975532df4d7 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:39.014693 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-4e97dd10-842f-456f-b372-5975532df4d7 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:39.015203 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-e7d2ae15-02eb-4716-a69d-f309e073acfe tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] 10.222.0.115 "GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e" status: 200 len: 1679 microversion: 2.1 time: 0.223935 Aug 02 10:58:39.016042 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 235/474] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:58:38 2022] GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e => generated 1679 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:58:39.157610 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-4e97dd10-842f-456f-b372-5975532df4d7 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bc14ada1564911b2f0a698aef3f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a4a0cf1852449e8bfc59ddb5a902c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:39.157610 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-4e97dd10-842f-456f-b372-5975532df4d7 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "GET /compute/v2.1/servers/a780ca09-3975-44eb-9464-355460c10686" status: 200 len: 1369 microversion: 2.1 time: 0.154318 Aug 02 10:58:39.157610 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 240/475] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:58:39 2022] GET /compute/v2.1/servers/a780ca09-3975-44eb-9464-355460c10686 => generated 1369 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:58:39.418152 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [req-50426594-eab2-4bc8-a690-8fd7a5111f1f req-50b9fbdc-3be5-40e7-971e-8340f5933292 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a", "name": "network-vif-plugged", "status": "completed", "tag": "83daf3e6-2460-4c6a-8114-303f93cdd38a"}]} {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:58:39.429244 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [req-50426594-eab2-4bc8-a690-8fd7a5111f1f req-50b9fbdc-3be5-40e7-971e-8340f5933292 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:39.429685 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [req-50426594-eab2-4bc8-a690-8fd7a5111f1f req-50b9fbdc-3be5-40e7-971e-8340f5933292 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:39.441922 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.compute.server_external_events [req-50426594-eab2-4bc8-a690-8fd7a5111f1f req-50b9fbdc-3be5-40e7-971e-8340f5933292 service nova] Creating event network-vif-plugged:83daf3e6-2460-4c6a-8114-303f93cdd38a for instance 8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a on hv-cinder-85031 Aug 02 10:58:39.446785 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [req-50426594-eab2-4bc8-a690-8fd7a5111f1f req-50b9fbdc-3be5-40e7-971e-8340f5933292 service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032494 Aug 02 10:58:39.449562 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 236/476] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Aug 2 10:58:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:58:39.624228 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [req-da9d2f82-02d9-4359-9925-f246980a46a7 req-c33e0f54-f80f-4473-a3c5-aff79e8f2016 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a780ca09-3975-44eb-9464-355460c10686", "tag": "3632c3f9-a9a8-4c3d-8f53-e11c70651bbf"}]} {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:58:39.634501 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [req-da9d2f82-02d9-4359-9925-f246980a46a7 req-c33e0f54-f80f-4473-a3c5-aff79e8f2016 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:39.635098 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [req-da9d2f82-02d9-4359-9925-f246980a46a7 req-c33e0f54-f80f-4473-a3c5-aff79e8f2016 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:39.646615 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.compute.server_external_events [req-da9d2f82-02d9-4359-9925-f246980a46a7 req-c33e0f54-f80f-4473-a3c5-aff79e8f2016 service nova] Creating event network-changed:3632c3f9-a9a8-4c3d-8f53-e11c70651bbf for instance a780ca09-3975-44eb-9464-355460c10686 on hv-cinder-85031 Aug 02 10:58:39.651573 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [req-da9d2f82-02d9-4359-9925-f246980a46a7 req-c33e0f54-f80f-4473-a3c5-aff79e8f2016 service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031604 Aug 02 10:58:39.652504 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 241/477] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Aug 2 10:58:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:58:40.021680 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-ff8b21df-439b-42d2-bd50-6955f2493ab7 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:40.022375 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-ff8b21df-439b-42d2-bd50-6955f2493ab7 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:40.028637 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-ff8b21df-439b-42d2-bd50-6955f2493ab7 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:40.029137 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-ff8b21df-439b-42d2-bd50-6955f2493ab7 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:40.029980 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-ff8b21df-439b-42d2-bd50-6955f2493ab7 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:40.030415 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-ff8b21df-439b-42d2-bd50-6955f2493ab7 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:40.038814 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-f1f4024b-393a-4237-9055-7e831f469cd1 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:40.039580 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-f1f4024b-393a-4237-9055-7e831f469cd1 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] [instance: 3938932a-e778-4c0c-9ab0-78dc9082a48e] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:40.046207 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-f1f4024b-393a-4237-9055-7e831f469cd1 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:40.048537 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-f1f4024b-393a-4237-9055-7e831f469cd1 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:40.048537 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-f1f4024b-393a-4237-9055-7e831f469cd1 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:40.048537 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-f1f4024b-393a-4237-9055-7e831f469cd1 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:40.237381 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-ff8b21df-439b-42d2-bd50-6955f2493ab7 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:40.238994 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG dbcounter [-] [129952] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=129952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:58:40.243557 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-ff8b21df-439b-42d2-bd50-6955f2493ab7 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a" status: 200 len: 1376 microversion: 2.1 time: 0.226399 Aug 02 10:58:40.244140 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 237/478] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:58:40 2022] GET /compute/v2.1/servers/8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a => generated 1376 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:58:40.245286 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-f1f4024b-393a-4237-9055-7e831f469cd1 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f41f17f5154e01a699043edc350cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e92110a1545f1b84644b8971bb6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:40.250539 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-baf558f0-1ce8-46c7-8dc9-9659c4643db6 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:40.251484 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-baf558f0-1ce8-46c7-8dc9-9659c4643db6 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: a780ca09-3975-44eb-9464-355460c10686] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:40.254910 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-f1f4024b-393a-4237-9055-7e831f469cd1 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] 10.222.0.115 "GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e" status: 200 len: 1679 microversion: 2.1 time: 0.220684 Aug 02 10:58:40.267076 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 242/479] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:58:40 2022] GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e => generated 1679 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:58:40.267314 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-baf558f0-1ce8-46c7-8dc9-9659c4643db6 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:40.267314 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-baf558f0-1ce8-46c7-8dc9-9659c4643db6 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:40.267314 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-baf558f0-1ce8-46c7-8dc9-9659c4643db6 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:40.267314 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-baf558f0-1ce8-46c7-8dc9-9659c4643db6 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:40.410370 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-baf558f0-1ce8-46c7-8dc9-9659c4643db6 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bc14ada1564911b2f0a698aef3f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a4a0cf1852449e8bfc59ddb5a902c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:40.418689 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-baf558f0-1ce8-46c7-8dc9-9659c4643db6 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "GET /compute/v2.1/servers/a780ca09-3975-44eb-9464-355460c10686" status: 200 len: 1369 microversion: 2.1 time: 0.173334 Aug 02 10:58:40.420322 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 238/480] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:58:40 2022] GET /compute/v2.1/servers/a780ca09-3975-44eb-9464-355460c10686 => generated 1369 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:58:41.265924 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-c310e777-fe6e-4876-ab9a-ec62c9e36404 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:41.266535 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-c310e777-fe6e-4876-ab9a-ec62c9e36404 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:41.270203 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG dbcounter [-] [129953] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=8,nova_api:DELETE=1 {{(pid=129953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:58:41.273991 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-c310e777-fe6e-4876-ab9a-ec62c9e36404 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:41.274795 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-c310e777-fe6e-4876-ab9a-ec62c9e36404 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:41.275514 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-c310e777-fe6e-4876-ab9a-ec62c9e36404 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:41.275954 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-c310e777-fe6e-4876-ab9a-ec62c9e36404 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:41.277617 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-994c88f3-2c87-4550-b279-05bedc1917ce tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:41.282436 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-994c88f3-2c87-4550-b279-05bedc1917ce tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] [instance: 3938932a-e778-4c0c-9ab0-78dc9082a48e] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:41.286740 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-994c88f3-2c87-4550-b279-05bedc1917ce tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:41.287478 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-994c88f3-2c87-4550-b279-05bedc1917ce tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:41.288344 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-994c88f3-2c87-4550-b279-05bedc1917ce tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:41.288861 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-994c88f3-2c87-4550-b279-05bedc1917ce tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:41.488754 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-c310e777-fe6e-4876-ab9a-ec62c9e36404 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:41.492176 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-994c88f3-2c87-4550-b279-05bedc1917ce tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f41f17f5154e01a699043edc350cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e92110a1545f1b84644b8971bb6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:41.496535 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-c310e777-fe6e-4876-ab9a-ec62c9e36404 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a" status: 200 len: 1376 microversion: 2.1 time: 0.234595 Aug 02 10:58:41.497872 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 243/481] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:58:41 2022] GET /compute/v2.1/servers/8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a => generated 1376 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:58:41.500604 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-994c88f3-2c87-4550-b279-05bedc1917ce tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] 10.222.0.115 "GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e" status: 200 len: 1679 microversion: 2.1 time: 0.227096 Aug 02 10:58:41.501318 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 239/482] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:58:41 2022] GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e => generated 1679 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:58:41.502324 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-5ae2aaa1-e646-48e5-9b83-333a695af6b9 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:41.503191 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-5ae2aaa1-e646-48e5-9b83-333a695af6b9 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: a780ca09-3975-44eb-9464-355460c10686] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:41.509355 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-5ae2aaa1-e646-48e5-9b83-333a695af6b9 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:41.509800 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-5ae2aaa1-e646-48e5-9b83-333a695af6b9 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:41.510549 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-5ae2aaa1-e646-48e5-9b83-333a695af6b9 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:41.510970 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-5ae2aaa1-e646-48e5-9b83-333a695af6b9 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:41.893764 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-5ae2aaa1-e646-48e5-9b83-333a695af6b9 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bc14ada1564911b2f0a698aef3f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a4a0cf1852449e8bfc59ddb5a902c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:41.901364 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-5ae2aaa1-e646-48e5-9b83-333a695af6b9 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "GET /compute/v2.1/servers/a780ca09-3975-44eb-9464-355460c10686" status: 200 len: 1369 microversion: 2.1 time: 0.402510 Aug 02 10:58:41.901944 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 244/483] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:58:41 2022] GET /compute/v2.1/servers/a780ca09-3975-44eb-9464-355460c10686 => generated 1369 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:58:42.518594 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-93b5b1b9-28f4-4463-a3d7-bc0522d3e5cd tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:42.519285 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-93b5b1b9-28f4-4463-a3d7-bc0522d3e5cd tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:42.521626 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-3536ce38-977f-4c3e-85b5-493299167b5f tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:42.522241 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-3536ce38-977f-4c3e-85b5-493299167b5f tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] [instance: 3938932a-e778-4c0c-9ab0-78dc9082a48e] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:42.526149 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-93b5b1b9-28f4-4463-a3d7-bc0522d3e5cd tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:42.526610 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-93b5b1b9-28f4-4463-a3d7-bc0522d3e5cd tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:42.527415 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-93b5b1b9-28f4-4463-a3d7-bc0522d3e5cd tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:42.527859 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-93b5b1b9-28f4-4463-a3d7-bc0522d3e5cd tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:42.529070 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-3536ce38-977f-4c3e-85b5-493299167b5f tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:42.529547 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-3536ce38-977f-4c3e-85b5-493299167b5f tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:42.530942 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-3536ce38-977f-4c3e-85b5-493299167b5f tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:42.537830 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-3536ce38-977f-4c3e-85b5-493299167b5f tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:42.726328 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-93b5b1b9-28f4-4463-a3d7-bc0522d3e5cd tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:42.729574 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-3536ce38-977f-4c3e-85b5-493299167b5f tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f41f17f5154e01a699043edc350cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e92110a1545f1b84644b8971bb6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:42.734741 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-93b5b1b9-28f4-4463-a3d7-bc0522d3e5cd tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a" status: 200 len: 1569 microversion: 2.1 time: 0.220668 Aug 02 10:58:42.735438 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 240/484] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:58:42 2022] GET /compute/v2.1/servers/8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a => generated 1569 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:58:42.738362 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-3536ce38-977f-4c3e-85b5-493299167b5f tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] 10.222.0.115 "GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e" status: 200 len: 1679 microversion: 2.1 time: 0.220655 Aug 02 10:58:42.738931 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 245/485] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:58:42 2022] GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e => generated 1679 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:58:42.755252 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-ba9b225f-baaf-42d5-8a30-fbd92bad79fe tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:42.755740 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-ba9b225f-baaf-42d5-8a30-fbd92bad79fe tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:42.761775 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-ba9b225f-baaf-42d5-8a30-fbd92bad79fe tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:42.762257 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-ba9b225f-baaf-42d5-8a30-fbd92bad79fe tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:42.763107 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-ba9b225f-baaf-42d5-8a30-fbd92bad79fe tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:42.763516 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-ba9b225f-baaf-42d5-8a30-fbd92bad79fe tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:42.841880 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-ba9b225f-baaf-42d5-8a30-fbd92bad79fe tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090396 Aug 02 10:58:42.842812 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 241/486] 10.222.0.115 () {58 vars in 1280 bytes} [Tue Aug 2 10:58:42 2022] GET /compute/v2.1/servers/8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:58:42.923112 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-17d3dd76-cb0c-4c5b-8db1-80f37355c971 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:42.923764 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-17d3dd76-cb0c-4c5b-8db1-80f37355c971 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: a780ca09-3975-44eb-9464-355460c10686] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:42.929730 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-17d3dd76-cb0c-4c5b-8db1-80f37355c971 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:42.930184 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-17d3dd76-cb0c-4c5b-8db1-80f37355c971 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:42.931082 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-17d3dd76-cb0c-4c5b-8db1-80f37355c971 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:42.931522 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-17d3dd76-cb0c-4c5b-8db1-80f37355c971 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:43.172334 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-17d3dd76-cb0c-4c5b-8db1-80f37355c971 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bc14ada1564911b2f0a698aef3f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a4a0cf1852449e8bfc59ddb5a902c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:43.179840 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-17d3dd76-cb0c-4c5b-8db1-80f37355c971 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "GET /compute/v2.1/servers/a780ca09-3975-44eb-9464-355460c10686" status: 200 len: 1369 microversion: 2.1 time: 0.260866 Aug 02 10:58:43.180425 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 246/487] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:58:42 2022] GET /compute/v2.1/servers/a780ca09-3975-44eb-9464-355460c10686 => generated 1369 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:58:43.760607 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-a4d69864-4de2-45ea-88fc-ee5f5dc2db6b tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:43.761183 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-a4d69864-4de2-45ea-88fc-ee5f5dc2db6b tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] [instance: 3938932a-e778-4c0c-9ab0-78dc9082a48e] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:43.769479 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-a4d69864-4de2-45ea-88fc-ee5f5dc2db6b tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:43.769923 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-a4d69864-4de2-45ea-88fc-ee5f5dc2db6b tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:43.770960 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-a4d69864-4de2-45ea-88fc-ee5f5dc2db6b tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:43.771144 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-a4d69864-4de2-45ea-88fc-ee5f5dc2db6b tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:43.983183 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-a4d69864-4de2-45ea-88fc-ee5f5dc2db6b tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f41f17f5154e01a699043edc350cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e92110a1545f1b84644b8971bb6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:43.993415 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-a4d69864-4de2-45ea-88fc-ee5f5dc2db6b tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] 10.222.0.115 "GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e" status: 200 len: 1679 microversion: 2.1 time: 0.237201 Aug 02 10:58:43.994069 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 242/488] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:58:43 2022] GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e => generated 1679 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:58:43.998481 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [req-859e4cd3-fc17-4f83-a5a2-0b0b2b9e3fa5 req-e3c22908-cc95-4c18-b386-91e7bf0898f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a", "tag": "83daf3e6-2460-4c6a-8114-303f93cdd38a"}]} {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:58:44.013448 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [req-859e4cd3-fc17-4f83-a5a2-0b0b2b9e3fa5 req-e3c22908-cc95-4c18-b386-91e7bf0898f3 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:44.013797 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [req-859e4cd3-fc17-4f83-a5a2-0b0b2b9e3fa5 req-e3c22908-cc95-4c18-b386-91e7bf0898f3 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:44.026500 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.compute.server_external_events [req-859e4cd3-fc17-4f83-a5a2-0b0b2b9e3fa5 req-e3c22908-cc95-4c18-b386-91e7bf0898f3 service nova] Creating event network-changed:83daf3e6-2460-4c6a-8114-303f93cdd38a for instance 8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a on hv-cinder-85031 Aug 02 10:58:44.032345 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [req-859e4cd3-fc17-4f83-a5a2-0b0b2b9e3fa5 req-e3c22908-cc95-4c18-b386-91e7bf0898f3 service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037645 Aug 02 10:58:44.032949 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 247/489] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Aug 2 10:58:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:58:44.203879 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-e34a69b4-61d6-4971-9a37-1b32a7e72b2c tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:44.204891 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-e34a69b4-61d6-4971-9a37-1b32a7e72b2c tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: a780ca09-3975-44eb-9464-355460c10686] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:44.212229 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-e34a69b4-61d6-4971-9a37-1b32a7e72b2c tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:44.213195 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-e34a69b4-61d6-4971-9a37-1b32a7e72b2c tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:44.213990 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-e34a69b4-61d6-4971-9a37-1b32a7e72b2c tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:44.214428 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-e34a69b4-61d6-4971-9a37-1b32a7e72b2c tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:44.354637 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-e34a69b4-61d6-4971-9a37-1b32a7e72b2c tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bc14ada1564911b2f0a698aef3f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a4a0cf1852449e8bfc59ddb5a902c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:44.362739 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-e34a69b4-61d6-4971-9a37-1b32a7e72b2c tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "GET /compute/v2.1/servers/a780ca09-3975-44eb-9464-355460c10686" status: 200 len: 1369 microversion: 2.1 time: 0.165222 Aug 02 10:58:44.363338 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 243/490] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:58:44 2022] GET /compute/v2.1/servers/a780ca09-3975-44eb-9464-355460c10686 => generated 1369 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:58:45.017090 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-3f1b9d33-852e-4c37-b554-6fe0371d08ae tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:45.017793 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-3f1b9d33-852e-4c37-b554-6fe0371d08ae tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] [instance: 3938932a-e778-4c0c-9ab0-78dc9082a48e] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:45.024156 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-3f1b9d33-852e-4c37-b554-6fe0371d08ae tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:45.024612 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-3f1b9d33-852e-4c37-b554-6fe0371d08ae tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:45.025440 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-3f1b9d33-852e-4c37-b554-6fe0371d08ae tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:45.025870 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-3f1b9d33-852e-4c37-b554-6fe0371d08ae tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:45.164883 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-3f1b9d33-852e-4c37-b554-6fe0371d08ae tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f41f17f5154e01a699043edc350cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e92110a1545f1b84644b8971bb6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:45.172675 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-3f1b9d33-852e-4c37-b554-6fe0371d08ae tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] 10.222.0.115 "GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e" status: 200 len: 1679 microversion: 2.1 time: 0.160832 Aug 02 10:58:45.173248 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 248/491] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:58:45 2022] GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:58:45.385048 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-1467275a-6314-4c88-abcf-fe4f7326204e tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:45.385660 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-1467275a-6314-4c88-abcf-fe4f7326204e tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: a780ca09-3975-44eb-9464-355460c10686] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:45.392789 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-1467275a-6314-4c88-abcf-fe4f7326204e tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:45.393952 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-1467275a-6314-4c88-abcf-fe4f7326204e tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:45.402022 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-1467275a-6314-4c88-abcf-fe4f7326204e tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:45.402022 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-1467275a-6314-4c88-abcf-fe4f7326204e tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:45.529586 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-1467275a-6314-4c88-abcf-fe4f7326204e tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bc14ada1564911b2f0a698aef3f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a4a0cf1852449e8bfc59ddb5a902c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:45.532144 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG dbcounter [-] [129952] Writing DB stats nova_cell0:SELECT=4 {{(pid=129952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:58:45.538740 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-1467275a-6314-4c88-abcf-fe4f7326204e tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "GET /compute/v2.1/servers/a780ca09-3975-44eb-9464-355460c10686" status: 200 len: 1369 microversion: 2.1 time: 0.157555 Aug 02 10:58:45.539350 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 244/492] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:58:45 2022] GET /compute/v2.1/servers/a780ca09-3975-44eb-9464-355460c10686 => generated 1369 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:58:46.194742 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-3886f223-41ad-4c21-8300-7e00ad02b74f tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:46.195341 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-3886f223-41ad-4c21-8300-7e00ad02b74f tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] [instance: 3938932a-e778-4c0c-9ab0-78dc9082a48e] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:46.197353 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG dbcounter [-] [129953] Writing DB stats nova_cell0:SELECT=4 {{(pid=129953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:58:46.198183 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG dbcounter [-] [129953] Writing DB stats nova_cell0:SELECT=20 {{(pid=129953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:58:46.203534 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-3886f223-41ad-4c21-8300-7e00ad02b74f tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:46.204047 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-3886f223-41ad-4c21-8300-7e00ad02b74f tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:46.204836 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-3886f223-41ad-4c21-8300-7e00ad02b74f tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:46.205598 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-3886f223-41ad-4c21-8300-7e00ad02b74f tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:46.209622 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG dbcounter [-] [129953] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:58:46.339603 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-3886f223-41ad-4c21-8300-7e00ad02b74f tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f41f17f5154e01a699043edc350cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e92110a1545f1b84644b8971bb6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:46.348315 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-3886f223-41ad-4c21-8300-7e00ad02b74f tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] 10.222.0.115 "GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e" status: 200 len: 1679 microversion: 2.1 time: 0.158131 Aug 02 10:58:46.348824 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 249/493] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:58:46 2022] GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:58:46.560055 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-7dc45f69-2f92-4b87-b008-28a4ef178851 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:46.560584 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-7dc45f69-2f92-4b87-b008-28a4ef178851 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: a780ca09-3975-44eb-9464-355460c10686] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:46.567736 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-7dc45f69-2f92-4b87-b008-28a4ef178851 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:46.568189 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-7dc45f69-2f92-4b87-b008-28a4ef178851 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:46.568957 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-7dc45f69-2f92-4b87-b008-28a4ef178851 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:46.569411 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-7dc45f69-2f92-4b87-b008-28a4ef178851 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:46.699638 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-7dc45f69-2f92-4b87-b008-28a4ef178851 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bc14ada1564911b2f0a698aef3f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a4a0cf1852449e8bfc59ddb5a902c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:46.707252 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-7dc45f69-2f92-4b87-b008-28a4ef178851 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "GET /compute/v2.1/servers/a780ca09-3975-44eb-9464-355460c10686" status: 200 len: 1369 microversion: 2.1 time: 0.151568 Aug 02 10:58:46.707817 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 245/494] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:58:46 2022] GET /compute/v2.1/servers/a780ca09-3975-44eb-9464-355460c10686 => generated 1369 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:58:47.370146 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-5e0f51cc-122c-4cc7-a2af-c7f67585c423 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:47.372170 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-5e0f51cc-122c-4cc7-a2af-c7f67585c423 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] [instance: 3938932a-e778-4c0c-9ab0-78dc9082a48e] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:47.378857 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-5e0f51cc-122c-4cc7-a2af-c7f67585c423 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:47.379401 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-5e0f51cc-122c-4cc7-a2af-c7f67585c423 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:47.380261 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-5e0f51cc-122c-4cc7-a2af-c7f67585c423 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:47.380704 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-5e0f51cc-122c-4cc7-a2af-c7f67585c423 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:47.444802 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [req-75cfa161-117e-4d44-a1bd-448f5038ea38 req-30af40b5-6538-4d23-9471-38067ccfa09b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a780ca09-3975-44eb-9464-355460c10686", "name": "network-vif-plugged", "status": "completed", "tag": "3632c3f9-a9a8-4c3d-8f53-e11c70651bbf"}]} {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:58:47.454972 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [req-75cfa161-117e-4d44-a1bd-448f5038ea38 req-30af40b5-6538-4d23-9471-38067ccfa09b service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:47.456002 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [req-75cfa161-117e-4d44-a1bd-448f5038ea38 req-30af40b5-6538-4d23-9471-38067ccfa09b service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:47.468634 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.compute.server_external_events [req-75cfa161-117e-4d44-a1bd-448f5038ea38 req-30af40b5-6538-4d23-9471-38067ccfa09b service nova] Creating event network-vif-plugged:3632c3f9-a9a8-4c3d-8f53-e11c70651bbf for instance a780ca09-3975-44eb-9464-355460c10686 on hv-cinder-85031 Aug 02 10:58:47.474786 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [req-75cfa161-117e-4d44-a1bd-448f5038ea38 req-30af40b5-6538-4d23-9471-38067ccfa09b service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034940 Aug 02 10:58:47.475471 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 246/495] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Aug 2 10:58:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:58:47.526348 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-5e0f51cc-122c-4cc7-a2af-c7f67585c423 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f41f17f5154e01a699043edc350cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e92110a1545f1b84644b8971bb6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:47.535083 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-5e0f51cc-122c-4cc7-a2af-c7f67585c423 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] 10.222.0.115 "GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e" status: 200 len: 1679 microversion: 2.1 time: 0.168790 Aug 02 10:58:47.535672 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 250/496] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:58:47 2022] GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e => generated 1679 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:58:47.729745 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-1d4dba7e-b9f8-438a-91e2-a7d0ad02b67d tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:47.730340 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-1d4dba7e-b9f8-438a-91e2-a7d0ad02b67d tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: a780ca09-3975-44eb-9464-355460c10686] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:47.736745 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-1d4dba7e-b9f8-438a-91e2-a7d0ad02b67d tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:47.737251 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-1d4dba7e-b9f8-438a-91e2-a7d0ad02b67d tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:47.738016 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-1d4dba7e-b9f8-438a-91e2-a7d0ad02b67d tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:47.738455 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-1d4dba7e-b9f8-438a-91e2-a7d0ad02b67d tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:47.875670 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-1d4dba7e-b9f8-438a-91e2-a7d0ad02b67d tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bc14ada1564911b2f0a698aef3f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a4a0cf1852449e8bfc59ddb5a902c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:47.883512 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-1d4dba7e-b9f8-438a-91e2-a7d0ad02b67d tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "GET /compute/v2.1/servers/a780ca09-3975-44eb-9464-355460c10686" status: 200 len: 1369 microversion: 2.1 time: 0.158480 Aug 02 10:58:47.884242 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 247/497] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:58:47 2022] GET /compute/v2.1/servers/a780ca09-3975-44eb-9464-355460c10686 => generated 1369 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 10:58:48.557306 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-c3af59ea-e37c-4e7d-92fa-ad00b030379d tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:48.557912 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-c3af59ea-e37c-4e7d-92fa-ad00b030379d tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] [instance: 3938932a-e778-4c0c-9ab0-78dc9082a48e] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:48.564495 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-c3af59ea-e37c-4e7d-92fa-ad00b030379d tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:48.565069 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-c3af59ea-e37c-4e7d-92fa-ad00b030379d tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:48.566587 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-c3af59ea-e37c-4e7d-92fa-ad00b030379d tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:48.567018 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-c3af59ea-e37c-4e7d-92fa-ad00b030379d tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:48.698698 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-c3af59ea-e37c-4e7d-92fa-ad00b030379d tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f41f17f5154e01a699043edc350cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e92110a1545f1b84644b8971bb6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:48.706588 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-c3af59ea-e37c-4e7d-92fa-ad00b030379d tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] 10.222.0.115 "GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e" status: 200 len: 1679 microversion: 2.1 time: 0.153212 Aug 02 10:58:48.707188 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 251/498] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:58:48 2022] GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:58:48.905164 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-4bc8a1af-2408-405f-ad82-de4c831be74b tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:48.905812 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-4bc8a1af-2408-405f-ad82-de4c831be74b tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: a780ca09-3975-44eb-9464-355460c10686] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:48.913784 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-4bc8a1af-2408-405f-ad82-de4c831be74b tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:48.914168 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-4bc8a1af-2408-405f-ad82-de4c831be74b tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:48.914927 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-4bc8a1af-2408-405f-ad82-de4c831be74b tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:48.915394 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-4bc8a1af-2408-405f-ad82-de4c831be74b tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:49.050449 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-4bc8a1af-2408-405f-ad82-de4c831be74b tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bc14ada1564911b2f0a698aef3f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a4a0cf1852449e8bfc59ddb5a902c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:49.057910 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-4bc8a1af-2408-405f-ad82-de4c831be74b tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "GET /compute/v2.1/servers/a780ca09-3975-44eb-9464-355460c10686" status: 200 len: 1369 microversion: 2.1 time: 0.156691 Aug 02 10:58:49.058481 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 248/499] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:58:48 2022] GET /compute/v2.1/servers/a780ca09-3975-44eb-9464-355460c10686 => generated 1369 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:58:49.728041 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-6eca07b9-62d2-4757-a6bb-3dd1b9a40a36 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:49.728594 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-6eca07b9-62d2-4757-a6bb-3dd1b9a40a36 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] [instance: 3938932a-e778-4c0c-9ab0-78dc9082a48e] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:49.735327 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-6eca07b9-62d2-4757-a6bb-3dd1b9a40a36 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:49.735805 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-6eca07b9-62d2-4757-a6bb-3dd1b9a40a36 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:49.736601 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-6eca07b9-62d2-4757-a6bb-3dd1b9a40a36 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:49.737161 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-6eca07b9-62d2-4757-a6bb-3dd1b9a40a36 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:49.867911 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-6eca07b9-62d2-4757-a6bb-3dd1b9a40a36 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f41f17f5154e01a699043edc350cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e92110a1545f1b84644b8971bb6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:49.875345 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-6eca07b9-62d2-4757-a6bb-3dd1b9a40a36 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] 10.222.0.115 "GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e" status: 200 len: 1679 microversion: 2.1 time: 0.151242 Aug 02 10:58:49.875902 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 252/500] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:58:49 2022] GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:58:50.078757 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-c613b935-c85b-4458-b5ec-8cc3d89da057 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:50.079362 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-c613b935-c85b-4458-b5ec-8cc3d89da057 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: a780ca09-3975-44eb-9464-355460c10686] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:50.086151 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-c613b935-c85b-4458-b5ec-8cc3d89da057 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:50.086590 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-c613b935-c85b-4458-b5ec-8cc3d89da057 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:50.087388 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-c613b935-c85b-4458-b5ec-8cc3d89da057 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:50.087821 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-c613b935-c85b-4458-b5ec-8cc3d89da057 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:50.222140 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-c613b935-c85b-4458-b5ec-8cc3d89da057 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bc14ada1564911b2f0a698aef3f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a4a0cf1852449e8bfc59ddb5a902c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:50.230225 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-c613b935-c85b-4458-b5ec-8cc3d89da057 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "GET /compute/v2.1/servers/a780ca09-3975-44eb-9464-355460c10686" status: 200 len: 1559 microversion: 2.1 time: 0.155432 Aug 02 10:58:50.230800 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 249/501] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:58:50 2022] GET /compute/v2.1/servers/a780ca09-3975-44eb-9464-355460c10686 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:58:50.251321 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-9fd95e32-7c1e-46e5-971c-26b42dd0078f tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:50.251839 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-9fd95e32-7c1e-46e5-971c-26b42dd0078f tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: a780ca09-3975-44eb-9464-355460c10686] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:50.258218 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-9fd95e32-7c1e-46e5-971c-26b42dd0078f tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:50.258663 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-9fd95e32-7c1e-46e5-971c-26b42dd0078f tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:50.259523 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-9fd95e32-7c1e-46e5-971c-26b42dd0078f tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:50.259894 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-9fd95e32-7c1e-46e5-971c-26b42dd0078f tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:50.337612 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-9fd95e32-7c1e-46e5-971c-26b42dd0078f tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "GET /compute/v2.1/servers/a780ca09-3975-44eb-9464-355460c10686/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090114 Aug 02 10:58:50.338202 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 253/502] 10.222.0.115 () {58 vars in 1280 bytes} [Tue Aug 2 10:58:50 2022] GET /compute/v2.1/servers/a780ca09-3975-44eb-9464-355460c10686/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:58:50.897827 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-b249cb27-c206-4991-8ea8-a92302916ba0 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:50.898439 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-b249cb27-c206-4991-8ea8-a92302916ba0 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] [instance: 3938932a-e778-4c0c-9ab0-78dc9082a48e] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:50.904743 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-b249cb27-c206-4991-8ea8-a92302916ba0 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:50.905134 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-b249cb27-c206-4991-8ea8-a92302916ba0 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:50.905893 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-b249cb27-c206-4991-8ea8-a92302916ba0 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:50.906585 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-b249cb27-c206-4991-8ea8-a92302916ba0 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:51.367648 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-b249cb27-c206-4991-8ea8-a92302916ba0 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f41f17f5154e01a699043edc350cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e92110a1545f1b84644b8971bb6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:51.375257 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-b249cb27-c206-4991-8ea8-a92302916ba0 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] 10.222.0.115 "GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e" status: 200 len: 1679 microversion: 2.1 time: 0.481363 Aug 02 10:58:51.375827 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 250/503] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:58:50 2022] GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e => generated 1679 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:58:51.671358 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [req-2c658e71-9b74-4388-9f96-f389150f7575 req-00d6992b-69fd-400d-8a5f-842684f9a76e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a780ca09-3975-44eb-9464-355460c10686", "tag": "3632c3f9-a9a8-4c3d-8f53-e11c70651bbf"}]} {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:58:51.682616 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [req-2c658e71-9b74-4388-9f96-f389150f7575 req-00d6992b-69fd-400d-8a5f-842684f9a76e service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:51.683077 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [req-2c658e71-9b74-4388-9f96-f389150f7575 req-00d6992b-69fd-400d-8a5f-842684f9a76e service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:51.695798 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.compute.server_external_events [req-2c658e71-9b74-4388-9f96-f389150f7575 req-00d6992b-69fd-400d-8a5f-842684f9a76e service nova] Creating event network-changed:3632c3f9-a9a8-4c3d-8f53-e11c70651bbf for instance a780ca09-3975-44eb-9464-355460c10686 on hv-cinder-85031 Aug 02 10:58:51.700818 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [req-2c658e71-9b74-4388-9f96-f389150f7575 req-00d6992b-69fd-400d-8a5f-842684f9a76e service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033691 Aug 02 10:58:51.701422 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 254/504] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Aug 2 10:58:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:58:52.397856 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-7b95f80e-e45c-40c5-81b4-a7fec508c455 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:52.398510 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-7b95f80e-e45c-40c5-81b4-a7fec508c455 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] [instance: 3938932a-e778-4c0c-9ab0-78dc9082a48e] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:52.405135 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-7b95f80e-e45c-40c5-81b4-a7fec508c455 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:52.405847 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-7b95f80e-e45c-40c5-81b4-a7fec508c455 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:52.406946 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-7b95f80e-e45c-40c5-81b4-a7fec508c455 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:52.407600 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-7b95f80e-e45c-40c5-81b4-a7fec508c455 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:52.560063 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-7b95f80e-e45c-40c5-81b4-a7fec508c455 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f41f17f5154e01a699043edc350cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e92110a1545f1b84644b8971bb6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:52.570656 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-7b95f80e-e45c-40c5-81b4-a7fec508c455 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] 10.222.0.115 "GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e" status: 200 len: 1679 microversion: 2.1 time: 0.177241 Aug 02 10:58:52.571336 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 251/505] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:58:52 2022] GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e => generated 1679 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:58:53.592450 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-c280192b-3bd5-4824-84bb-9841d5915cfa tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:53.593147 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-c280192b-3bd5-4824-84bb-9841d5915cfa tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] [instance: 3938932a-e778-4c0c-9ab0-78dc9082a48e] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:53.600048 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-c280192b-3bd5-4824-84bb-9841d5915cfa tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:53.600497 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-c280192b-3bd5-4824-84bb-9841d5915cfa tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:53.601259 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-c280192b-3bd5-4824-84bb-9841d5915cfa tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:53.601695 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-c280192b-3bd5-4824-84bb-9841d5915cfa tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:53.732684 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-c280192b-3bd5-4824-84bb-9841d5915cfa tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f41f17f5154e01a699043edc350cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e92110a1545f1b84644b8971bb6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:53.741511 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-c280192b-3bd5-4824-84bb-9841d5915cfa tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] 10.222.0.115 "GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e" status: 200 len: 1656 microversion: 2.1 time: 0.153157 Aug 02 10:58:53.747190 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 255/506] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:58:53 2022] GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e => generated 1656 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:58:53.764755 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-652ae440-4d15-436b-9b5d-c9f014aa711f tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:58:53.771601 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-652ae440-4d15-436b-9b5d-c9f014aa711f tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:53.772076 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-652ae440-4d15-436b-9b5d-c9f014aa711f tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:53.794159 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-652ae440-4d15-436b-9b5d-c9f014aa711f tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] [instance: 3938932a-e778-4c0c-9ab0-78dc9082a48e] Going to try to start instance {{(pid=129952) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 02 10:58:53.998729 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-652ae440-4d15-436b-9b5d-c9f014aa711f tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] 10.222.0.115 "POST /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e/action" status: 202 len: 0 microversion: 2.1 time: 0.237723 Aug 02 10:58:53.999240 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 252/507] 10.222.0.115 () {60 vars in 1283 bytes} [Tue Aug 2 10:58:53 2022] POST /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e/action => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 10:58:54.007638 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-d7b7fe50-b3ab-4b14-a474-e63cde4017d2 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:54.008271 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-d7b7fe50-b3ab-4b14-a474-e63cde4017d2 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] [instance: 3938932a-e778-4c0c-9ab0-78dc9082a48e] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:54.014404 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-d7b7fe50-b3ab-4b14-a474-e63cde4017d2 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:54.014848 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-d7b7fe50-b3ab-4b14-a474-e63cde4017d2 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:54.015637 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-d7b7fe50-b3ab-4b14-a474-e63cde4017d2 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:54.016062 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-d7b7fe50-b3ab-4b14-a474-e63cde4017d2 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:54.149446 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-d7b7fe50-b3ab-4b14-a474-e63cde4017d2 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f41f17f5154e01a699043edc350cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e92110a1545f1b84644b8971bb6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:54.157312 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-d7b7fe50-b3ab-4b14-a474-e63cde4017d2 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] 10.222.0.115 "GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e" status: 200 len: 1665 microversion: 2.1 time: 0.153909 Aug 02 10:58:54.157882 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 256/508] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:58:54 2022] GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e => generated 1665 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:58:55.181508 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-e63e2127-d238-4e48-a885-24a254387c46 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:55.182216 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-e63e2127-d238-4e48-a885-24a254387c46 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] [instance: 3938932a-e778-4c0c-9ab0-78dc9082a48e] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:55.188658 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-e63e2127-d238-4e48-a885-24a254387c46 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:55.189112 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-e63e2127-d238-4e48-a885-24a254387c46 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:55.189888 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-e63e2127-d238-4e48-a885-24a254387c46 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:55.190349 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-e63e2127-d238-4e48-a885-24a254387c46 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:55.329440 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-e63e2127-d238-4e48-a885-24a254387c46 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f41f17f5154e01a699043edc350cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e92110a1545f1b84644b8971bb6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:55.337722 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-e63e2127-d238-4e48-a885-24a254387c46 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] 10.222.0.115 "GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e" status: 200 len: 1665 microversion: 2.1 time: 0.161150 Aug 02 10:58:55.338283 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 253/509] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:58:55 2022] GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e => generated 1665 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:58:56.359260 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-e2409669-b4f9-4ed9-a8ad-12fd0e8afb8b tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:58:56.359847 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-e2409669-b4f9-4ed9-a8ad-12fd0e8afb8b tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] [instance: 3938932a-e778-4c0c-9ab0-78dc9082a48e] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:58:56.367219 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-e2409669-b4f9-4ed9-a8ad-12fd0e8afb8b tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:56.367668 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-e2409669-b4f9-4ed9-a8ad-12fd0e8afb8b tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:56.368447 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-e2409669-b4f9-4ed9-a8ad-12fd0e8afb8b tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:58:56.368882 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-e2409669-b4f9-4ed9-a8ad-12fd0e8afb8b tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:58:56.501998 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-e2409669-b4f9-4ed9-a8ad-12fd0e8afb8b tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f41f17f5154e01a699043edc350cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e92110a1545f1b84644b8971bb6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:58:56.512166 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-e2409669-b4f9-4ed9-a8ad-12fd0e8afb8b tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] 10.222.0.115 "GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e" status: 200 len: 1669 microversion: 2.1 time: 0.156603 Aug 02 10:58:56.512587 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 257/510] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:58:56 2022] GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e => generated 1669 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:59:02.816977 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-1cabdca4-ffb6-48e1-a4e7-136ec005877b tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:59:02.817550 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-1cabdca4-ffb6-48e1-a4e7-136ec005877b tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: b3a92fc5-5c44-48d1-8394-535687bb6ae3] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:59:02.820816 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG dbcounter [-] [129952] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1 {{(pid=129952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:59:02.825949 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-1cabdca4-ffb6-48e1-a4e7-136ec005877b tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:02.826402 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-1cabdca4-ffb6-48e1-a4e7-136ec005877b tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:02.827230 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-1cabdca4-ffb6-48e1-a4e7-136ec005877b tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:02.827860 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-1cabdca4-ffb6-48e1-a4e7-136ec005877b tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:02.845506 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG dbcounter [-] [129952] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:59:02.859983 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-1cabdca4-ffb6-48e1-a4e7-136ec005877b tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3/os-volume_attachments/1dee1c87-78cf-4483-9c38-fa40c80c9238" status: 200 len: 194 microversion: 2.20 time: 0.047112 Aug 02 10:59:02.860561 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 254/511] 10.222.0.115 () {60 vars in 1459 bytes} [Tue Aug 2 10:59:02 2022] GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3/os-volume_attachments/1dee1c87-78cf-4483-9c38-fa40c80c9238 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 10:59:02.930608 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-2b5caafc-c256-4d35-9420-31223866dc5b tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:59:02.935192 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-2b5caafc-c256-4d35-9420-31223866dc5b tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: b3a92fc5-5c44-48d1-8394-535687bb6ae3] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:59:02.937811 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-2b5caafc-c256-4d35-9420-31223866dc5b tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:02.938256 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-2b5caafc-c256-4d35-9420-31223866dc5b tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:02.939016 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-2b5caafc-c256-4d35-9420-31223866dc5b tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:02.939474 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-2b5caafc-c256-4d35-9420-31223866dc5b tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:03.119498 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.objects.instance [None req-2b5caafc-c256-4d35-9420-31223866dc5b tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lazy-loading 'services' on Instance uuid b3a92fc5-5c44-48d1-8394-535687bb6ae3 {{(pid=129953) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 10:59:03.401310 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-2b5caafc-c256-4d35-9420-31223866dc5b tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "DELETE /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3/os-volume_attachments/1dee1c87-78cf-4483-9c38-fa40c80c9238" status: 202 len: 0 microversion: 2.20 time: 0.475184 Aug 02 10:59:03.401915 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 258/512] 10.222.0.115 () {60 vars in 1462 bytes} [Tue Aug 2 10:59:02 2022] DELETE /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3/os-volume_attachments/1dee1c87-78cf-4483-9c38-fa40c80c9238 => generated 0 bytes in 477 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 02 10:59:03.413553 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-a1df951d-f7a2-4ae9-8cd1-ab35ddcc9580 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:59:03.416162 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-a1df951d-f7a2-4ae9-8cd1-ab35ddcc9580 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: b3a92fc5-5c44-48d1-8394-535687bb6ae3] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:59:03.423683 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-a1df951d-f7a2-4ae9-8cd1-ab35ddcc9580 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:03.424268 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-a1df951d-f7a2-4ae9-8cd1-ab35ddcc9580 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:03.424925 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-a1df951d-f7a2-4ae9-8cd1-ab35ddcc9580 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:03.425372 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-a1df951d-f7a2-4ae9-8cd1-ab35ddcc9580 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:03.456963 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-a1df951d-f7a2-4ae9-8cd1-ab35ddcc9580 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049841 Aug 02 10:59:03.457541 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 255/513] 10.222.0.115 () {60 vars in 1348 bytes} [Tue Aug 2 10:59:03 2022] GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:59:04.471768 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-5c712212-f44f-4b98-8186-1b5ecbb51f51 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:59:04.474045 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-5c712212-f44f-4b98-8186-1b5ecbb51f51 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: b3a92fc5-5c44-48d1-8394-535687bb6ae3] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:59:04.481484 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-5c712212-f44f-4b98-8186-1b5ecbb51f51 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:04.481922 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-5c712212-f44f-4b98-8186-1b5ecbb51f51 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:04.482689 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-5c712212-f44f-4b98-8186-1b5ecbb51f51 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:04.483147 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-5c712212-f44f-4b98-8186-1b5ecbb51f51 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:04.514455 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-5c712212-f44f-4b98-8186-1b5ecbb51f51 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047638 Aug 02 10:59:04.515026 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 259/514] 10.222.0.115 () {60 vars in 1348 bytes} [Tue Aug 2 10:59:04 2022] GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:59:05.528334 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-fe31d701-e7a5-4d8b-931c-3340f187ba16 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:59:05.530472 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-fe31d701-e7a5-4d8b-931c-3340f187ba16 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: b3a92fc5-5c44-48d1-8394-535687bb6ae3] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:59:05.538607 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-fe31d701-e7a5-4d8b-931c-3340f187ba16 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:05.539068 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-fe31d701-e7a5-4d8b-931c-3340f187ba16 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:05.539821 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-fe31d701-e7a5-4d8b-931c-3340f187ba16 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:05.540251 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-fe31d701-e7a5-4d8b-931c-3340f187ba16 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:05.572281 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-fe31d701-e7a5-4d8b-931c-3340f187ba16 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048492 Aug 02 10:59:05.572860 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 256/515] 10.222.0.115 () {60 vars in 1348 bytes} [Tue Aug 2 10:59:05 2022] GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:59:05.636271 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-e904a65c-3e53-4409-8425-1d96acc9719e tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:59:05.636915 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-e904a65c-3e53-4409-8425-1d96acc9719e tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: b3a92fc5-5c44-48d1-8394-535687bb6ae3] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:59:05.643393 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-e904a65c-3e53-4409-8425-1d96acc9719e tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:05.643831 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-e904a65c-3e53-4409-8425-1d96acc9719e tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:05.644580 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-e904a65c-3e53-4409-8425-1d96acc9719e tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:05.645003 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-e904a65c-3e53-4409-8425-1d96acc9719e tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:05.671865 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-e904a65c-3e53-4409-8425-1d96acc9719e tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: b3a92fc5-5c44-48d1-8394-535687bb6ae3] Going to try to terminate instance {{(pid=129953) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 10:59:05.948198 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-e904a65c-3e53-4409-8425-1d96acc9719e tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "DELETE /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3" status: 204 len: 0 microversion: 2.20 time: 0.315859 Aug 02 10:59:05.948800 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 260/516] 10.222.0.115 () {60 vars in 1285 bytes} [Tue Aug 2 10:59:05 2022] DELETE /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 02 10:59:05.957627 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-d702bed8-bb2d-45ef-ac11-2ab4d5648929 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:59:05.958246 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-d702bed8-bb2d-45ef-ac11-2ab4d5648929 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: b3a92fc5-5c44-48d1-8394-535687bb6ae3] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:59:05.965089 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-d702bed8-bb2d-45ef-ac11-2ab4d5648929 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:05.965543 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-d702bed8-bb2d-45ef-ac11-2ab4d5648929 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:05.966313 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-d702bed8-bb2d-45ef-ac11-2ab4d5648929 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:05.966760 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-d702bed8-bb2d-45ef-ac11-2ab4d5648929 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:06.102692 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-d702bed8-bb2d-45ef-ac11-2ab4d5648929 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:59:06.110684 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-d702bed8-bb2d-45ef-ac11-2ab4d5648929 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:59:06.112207 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-d702bed8-bb2d-45ef-ac11-2ab4d5648929 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:59:06.113521 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-d702bed8-bb2d-45ef-ac11-2ab4d5648929 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3" status: 200 len: 1728 microversion: 2.20 time: 0.160428 Aug 02 10:59:06.114071 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 257/517] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 10:59:05 2022] GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3 => generated 1728 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:59:07.138370 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-281822d5-274c-45fa-910f-9e3699f34614 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:59:07.138975 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-281822d5-274c-45fa-910f-9e3699f34614 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: b3a92fc5-5c44-48d1-8394-535687bb6ae3] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:59:07.146404 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-281822d5-274c-45fa-910f-9e3699f34614 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:07.146874 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-281822d5-274c-45fa-910f-9e3699f34614 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:07.148325 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-281822d5-274c-45fa-910f-9e3699f34614 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:07.148787 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-281822d5-274c-45fa-910f-9e3699f34614 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:07.295159 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-281822d5-274c-45fa-910f-9e3699f34614 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:59:07.303408 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-281822d5-274c-45fa-910f-9e3699f34614 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:59:07.304930 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-281822d5-274c-45fa-910f-9e3699f34614 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:59:07.306100 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-281822d5-274c-45fa-910f-9e3699f34614 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3" status: 200 len: 1728 microversion: 2.20 time: 0.172446 Aug 02 10:59:07.306657 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 261/518] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 10:59:07 2022] GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3 => generated 1728 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:59:08.332922 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-d89858df-1159-46ab-9a48-99830446cdc6 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:59:08.340682 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-d89858df-1159-46ab-9a48-99830446cdc6 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: b3a92fc5-5c44-48d1-8394-535687bb6ae3] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:59:08.344935 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-d89858df-1159-46ab-9a48-99830446cdc6 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:08.345700 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-d89858df-1159-46ab-9a48-99830446cdc6 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:08.347058 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-d89858df-1159-46ab-9a48-99830446cdc6 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:08.347833 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-d89858df-1159-46ab-9a48-99830446cdc6 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:08.499253 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-d89858df-1159-46ab-9a48-99830446cdc6 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:59:08.508573 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-d89858df-1159-46ab-9a48-99830446cdc6 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:59:08.510257 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-d89858df-1159-46ab-9a48-99830446cdc6 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:59:08.511497 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-d89858df-1159-46ab-9a48-99830446cdc6 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3" status: 200 len: 1728 microversion: 2.20 time: 0.185491 Aug 02 10:59:08.512262 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 258/519] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 10:59:08 2022] GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3 => generated 1728 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:59:09.127032 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [req-4b39b960-cb21-41f9-b005-71b638c3cb10 req-91ca4d87-7115-4363-8034-f65e4cc8c8db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3a92fc5-5c44-48d1-8394-535687bb6ae3", "name": "network-vif-deleted", "tag": "03045dd7-30b5-4c87-bcb8-828046dbcd75"}]} {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:59:09.138193 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [req-4b39b960-cb21-41f9-b005-71b638c3cb10 req-91ca4d87-7115-4363-8034-f65e4cc8c8db service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:09.138639 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [req-4b39b960-cb21-41f9-b005-71b638c3cb10 req-91ca4d87-7115-4363-8034-f65e4cc8c8db service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:09.151585 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.compute.server_external_events [req-4b39b960-cb21-41f9-b005-71b638c3cb10 req-91ca4d87-7115-4363-8034-f65e4cc8c8db service nova] Creating event network-vif-deleted:03045dd7-30b5-4c87-bcb8-828046dbcd75 for instance b3a92fc5-5c44-48d1-8394-535687bb6ae3 on hv-cinder-85031 Aug 02 10:59:09.157733 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [req-4b39b960-cb21-41f9-b005-71b638c3cb10 req-91ca4d87-7115-4363-8034-f65e4cc8c8db service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034317 Aug 02 10:59:09.158786 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 262/520] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Aug 2 10:59:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:59:09.535167 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-4fbb3961-bb05-4911-8658-5dea99c61065 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:59:09.536828 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-4fbb3961-bb05-4911-8658-5dea99c61065 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: b3a92fc5-5c44-48d1-8394-535687bb6ae3] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:59:09.544559 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-4fbb3961-bb05-4911-8658-5dea99c61065 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:09.545078 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-4fbb3961-bb05-4911-8658-5dea99c61065 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:09.545862 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-4fbb3961-bb05-4911-8658-5dea99c61065 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:09.546952 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-4fbb3961-bb05-4911-8658-5dea99c61065 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:09.580975 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-4fbb3961-bb05-4911-8658-5dea99c61065 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:09.585083 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-4fbb3961-bb05-4911-8658-5dea99c61065 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:09.585083 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.objects.instance [None req-4fbb3961-bb05-4911-8658-5dea99c61065 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lazy-loading 'fault' on Instance uuid b3a92fc5-5c44-48d1-8394-535687bb6ae3 {{(pid=129952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 10:59:09.630962 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-4fbb3961-bb05-4911-8658-5dea99c61065 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:59:09.641018 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-4fbb3961-bb05-4911-8658-5dea99c61065 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:59:09.642761 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-4fbb3961-bb05-4911-8658-5dea99c61065 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:59:09.643970 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-4fbb3961-bb05-4911-8658-5dea99c61065 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3" status: 200 len: 1374 microversion: 2.20 time: 0.113431 Aug 02 10:59:09.644840 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 259/521] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 10:59:09 2022] GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3 => generated 1374 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:59:10.670116 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-f216e385-a714-4ff7-955e-b745d467d27b tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:59:10.670941 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-f216e385-a714-4ff7-955e-b745d467d27b tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: b3a92fc5-5c44-48d1-8394-535687bb6ae3] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:59:10.677737 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-f216e385-a714-4ff7-955e-b745d467d27b tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:10.678186 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-f216e385-a714-4ff7-955e-b745d467d27b tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:10.678953 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-f216e385-a714-4ff7-955e-b745d467d27b tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:10.679400 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-f216e385-a714-4ff7-955e-b745d467d27b tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:10.695850 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.wsgi [None req-f216e385-a714-4ff7-955e-b745d467d27b tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] HTTP exception thrown: Instance b3a92fc5-5c44-48d1-8394-535687bb6ae3 could not be found. Aug 02 10:59:10.697474 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-f216e385-a714-4ff7-955e-b745d467d27b tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Request method failure captured: Aug 02 10:59:10.697474 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: request: GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3 HTTP/1.1 Aug 02 10:59:10.697474 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Accept: application/json Aug 02 10:59:10.697474 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Accept-Encoding: identity Aug 02 10:59:10.697474 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Connection: close Aug 02 10:59:10.697474 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Content-Length: 0 Aug 02 10:59:10.697474 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Content-Type: application/json Aug 02 10:59:10.697474 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Host: 10.222.0.115 Aug 02 10:59:10.697474 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Openstack-System-Scope: None Aug 02 10:59:10.697474 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: User-Agent: python-urllib3/1.26.10 Aug 02 10:59:10.697474 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Auth-Token: gAAAAABi6QKPaxrUk-Rq_Ctk1SOGwm4XuIXMS_HBTTUeAPSkZXFKcj0Lxt_OaInefAqehpe4qU3OoSMMi--ESVj5jZNszpAfca9aWIuGwsIwUCQbVLiuRiX4ryZJJc4W5WY1NNrTZ9QsvW57sxv55X9CXuxJOzOet8on3cbUt2Xg-0SGLE0ilJQ Aug 02 10:59:10.697474 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Domain-Id: None Aug 02 10:59:10.697474 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Domain-Name: None Aug 02 10:59:10.697474 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Identity-Status: Confirmed Aug 02 10:59:10.697474 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Is-Admin-Project: True Aug 02 10:59:10.697474 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Openstack-Nova-Api-Version: 2.20 Aug 02 10:59:10.697474 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Project-Domain-Id: default Aug 02 10:59:10.697474 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Project-Domain-Name: Default Aug 02 10:59:10.697474 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Project-Id: 1b3a294d5d02485980c82f065ee76bd7 Aug 02 10:59:10.697474 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-209900741 Aug 02 10:59:10.697474 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Role: reader,member Aug 02 10:59:10.697474 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Roles: reader,member Aug 02 10:59:10.699191 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/1b3a294d5d02485980c82f065ee76bd7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2/1b3a294d5d02485980c82f065ee76bd7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/1b3a294d5d02485980c82f065ee76bd7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.115:8080", "publicURL": "http://10.222.0.115:8080/v1/AUTH_1b3a294d5d02485980c82f065ee76bd7"}]}] Aug 02 10:59:10.699191 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Tenant: tempest-AttachVolumeShelveTestJSON-209900741 Aug 02 10:59:10.699191 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Tenant-Id: 1b3a294d5d02485980c82f065ee76bd7 Aug 02 10:59:10.699191 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-209900741 Aug 02 10:59:10.699191 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User: tempest-AttachVolumeShelveTestJSON-209900741-project Aug 02 10:59:10.699191 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User-Domain-Id: default Aug 02 10:59:10.699191 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User-Domain-Name: Default Aug 02 10:59:10.699191 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User-Id: ab1211acdd9a4df48c46f8807ed00063 Aug 02 10:59:10.699191 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User-Name: tempest-AttachVolumeShelveTestJSON-209900741-project Aug 02 10:59:10.699191 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: method: > Aug 02 10:59:10.699191 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: exception: Instance b3a92fc5-5c44-48d1-8394-535687bb6ae3 could not be found. Aug 02 10:59:10.699191 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: action_args: {'id': 'b3a92fc5-5c44-48d1-8394-535687bb6ae3'} Aug 02 10:59:10.700130 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:59:10.700130 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:59:10.700130 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 10:59:10.700130 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 10:59:10.700130 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 10:59:10.700130 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 10:59:10.700130 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 10:59:10.700130 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 10:59:10.700130 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 10:59:10.700130 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 10:59:10.700130 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3a92fc5-5c44-48d1-8394-535687bb6ae3 could not be found. Aug 02 10:59:10.700130 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 10:59:10.700130 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:59:10.700130 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 10:59:10.700130 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:59:10.700130 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:59:10.700130 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:59:10.700130 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:59:10.700130 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:59:10.700130 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:59:10.701573 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:59:10.701573 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 10:59:10.701573 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 10:59:10.701573 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 10:59:10.701573 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 10:59:10.701573 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 10:59:10.701573 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 10:59:10.701573 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3a92fc5-5c44-48d1-8394-535687bb6ae3 could not be found. Aug 02 10:59:10.701573 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 10:59:10.701573 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:59:10.701573 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 10:59:10.701573 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:59:10.701573 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:59:10.701573 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:59:10.701573 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:59:10.701573 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:59:10.701573 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3a92fc5-5c44-48d1-8394-535687bb6ae3 could not be found. Aug 02 10:59:10.701573 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 10:59:10.702817 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-f216e385-a714-4ff7-955e-b745d467d27b tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Returning 404 to user: Instance b3a92fc5-5c44-48d1-8394-535687bb6ae3 could not be found. {{(pid=129953) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:59:10.702817 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-f216e385-a714-4ff7-955e-b745d467d27b tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3" status: 404 len: 111 microversion: 2.20 time: 0.033016 Aug 02 10:59:10.702817 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 263/522] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 10:59:10 2022] GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 02 10:59:10.708237 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-be738962-1a34-4a73-b63b-89335e29b325 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '.version_select at 0x7f7c4eda8af0>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:59:10.779465 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-be738962-1a34-4a73-b63b-89335e29b325 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-836339730" status: 204 len: 0 microversion: 2.20 time: 0.075034 Aug 02 10:59:10.780064 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 260/523] 10.222.0.115 () {60 vars in 1264 bytes} [Tue Aug 2 10:59:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-836339730 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 02 10:59:11.567208 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-95a1a3b7-1d5c-433e-9589-e9b700e87367 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Action: 'create', calling method: .version_select at 0x7f7c4e6568b0>, body: {"keypair": {"name": "tempest-keypair-805288474", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOh09+QrPLI6TJyIGQBKPpErXJATjwAcvfjhMDFLLdDLVTR/GEEfnw34DItmYQ14GRR7IAL97bk9B11eTIXiWJSypocP76LoNr86neTkA2Pdx2GGoYaov/6ZXk2HD8wb6A=="}} {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:59:11.573427 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG dbcounter [-] [129953] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=129953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:59:11.584448 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.quota [None req-95a1a3b7-1d5c-433e-9589-e9b700e87367 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Getting quotas for project 1b3a294d5d02485980c82f065ee76bd7. Resources: {'key_pairs'} {{(pid=129953) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 10:59:11.594658 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.quota [None req-95a1a3b7-1d5c-433e-9589-e9b700e87367 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Getting quotas for user ab1211acdd9a4df48c46f8807ed00063 and project 1b3a294d5d02485980c82f065ee76bd7. Resources: {'key_pairs'} {{(pid=129953) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 10:59:11.686237 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-95a1a3b7-1d5c-433e-9589-e9b700e87367 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.123024 Aug 02 10:59:11.686923 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 264/524] 10.222.0.115 () {62 vars in 1205 bytes} [Tue Aug 2 10:59:11 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 124 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 02 10:59:13.833675 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-bf9f78b7-2fbd-496e-9235-64ba444e7781 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-149689767", "imageRef": "aa0a7b8c-0dd6-4803-8767-cb8c2d05fdd4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7da1785e-f1d0-42a6-a98f-5f5946ede1eb"}], "security_groups": [{"name": "tempest-securitygroup--1895016447"}], "key_name": "tempest-keypair-805288474", "user_data": "}} {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:59:13.939738 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.network.neutron [None req-bf9f78b7-2fbd-496e-9235-64ba444e7781 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] validate_networks() for [('7da1785e-f1d0-42a6-a98f-5f5946ede1eb', None, None, None, None, None)] {{(pid=129952) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 10:59:14.311342 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.virt.hardware [None req-bf9f78b7-2fbd-496e-9235-64ba444e7781 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Flavor limits 0:0:0 {{(pid=129952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 10:59:14.311765 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.virt.hardware [None req-bf9f78b7-2fbd-496e-9235-64ba444e7781 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Image limits 0:0:0 {{(pid=129952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 10:59:14.312231 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.virt.hardware [None req-bf9f78b7-2fbd-496e-9235-64ba444e7781 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Flavor pref 0:0:0 {{(pid=129952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 10:59:14.312656 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.virt.hardware [None req-bf9f78b7-2fbd-496e-9235-64ba444e7781 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Image pref 0:0:0 {{(pid=129952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 10:59:14.313061 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.virt.hardware [None req-bf9f78b7-2fbd-496e-9235-64ba444e7781 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 10:59:14.322723 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-bf9f78b7-2fbd-496e-9235-64ba444e7781 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:14.323190 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-bf9f78b7-2fbd-496e-9235-64ba444e7781 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:14.324011 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-bf9f78b7-2fbd-496e-9235-64ba444e7781 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:14.324436 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-bf9f78b7-2fbd-496e-9235-64ba444e7781 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:14.342249 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.quota [None req-bf9f78b7-2fbd-496e-9235-64ba444e7781 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Getting quotas for project 1b3a294d5d02485980c82f065ee76bd7. Resources: {'instances', 'cores', 'ram'} {{(pid=129952) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 10:59:14.346201 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.quota [None req-bf9f78b7-2fbd-496e-9235-64ba444e7781 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Getting quotas for user ab1211acdd9a4df48c46f8807ed00063 and project 1b3a294d5d02485980c82f065ee76bd7. Resources: {'instances', 'cores', 'ram'} {{(pid=129952) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 10:59:14.358093 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-bf9f78b7-2fbd-496e-9235-64ba444e7781 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Going to run 1 instances... {{(pid=129952) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 10:59:14.360448 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-bf9f78b7-2fbd-496e-9235-64ba444e7781 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: f86a8852-12b8-46d3-bd9b-bc140757b4c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aa0a7b8c-0dd6-4803-8767-cb8c2d05fdd4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129952) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 10:59:14.567314 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-bf9f78b7-2fbd-496e-9235-64ba444e7781 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.20 time: 0.738420 Aug 02 10:59:14.567954 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 261/525] 10.222.0.115 () {62 vars in 1193 bytes} [Tue Aug 2 10:59:13 2022] POST /compute/v2.1/servers => generated 404 bytes in 740 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 02 10:59:14.579890 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-ed09e2f6-0a41-4f97-9cc1-c85d5b60cc9d tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:59:14.580629 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-ed09e2f6-0a41-4f97-9cc1-c85d5b60cc9d tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: f86a8852-12b8-46d3-bd9b-bc140757b4c5] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:59:14.643148 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-ed09e2f6-0a41-4f97-9cc1-c85d5b60cc9d tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:59:14.654232 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-ed09e2f6-0a41-4f97-9cc1-c85d5b60cc9d tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:59:14.656037 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-ed09e2f6-0a41-4f97-9cc1-c85d5b60cc9d tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:59:14.657325 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-ed09e2f6-0a41-4f97-9cc1-c85d5b60cc9d tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5" status: 200 len: 1284 microversion: 2.20 time: 0.081815 Aug 02 10:59:14.657838 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 265/526] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 10:59:14 2022] GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5 => generated 1284 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:59:15.681581 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-83371db2-9e87-4516-827d-6e501aa5e292 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:59:15.685993 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-83371db2-9e87-4516-827d-6e501aa5e292 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: f86a8852-12b8-46d3-bd9b-bc140757b4c5] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:59:15.688839 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-83371db2-9e87-4516-827d-6e501aa5e292 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:15.689291 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-83371db2-9e87-4516-827d-6e501aa5e292 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:15.690095 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-83371db2-9e87-4516-827d-6e501aa5e292 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:15.690532 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-83371db2-9e87-4516-827d-6e501aa5e292 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:15.757068 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-83371db2-9e87-4516-827d-6e501aa5e292 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:59:15.765284 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-83371db2-9e87-4516-827d-6e501aa5e292 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:59:15.766802 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-83371db2-9e87-4516-827d-6e501aa5e292 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:59:15.767948 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-83371db2-9e87-4516-827d-6e501aa5e292 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5" status: 200 len: 1288 microversion: 2.20 time: 0.091594 Aug 02 10:59:15.768745 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 262/527] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 10:59:15 2022] GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5 => generated 1288 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:59:16.791386 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-5e12ac62-c5b8-4204-b241-59fbb4d05d0c tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:59:16.791963 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-5e12ac62-c5b8-4204-b241-59fbb4d05d0c tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: f86a8852-12b8-46d3-bd9b-bc140757b4c5] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:59:16.798209 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-5e12ac62-c5b8-4204-b241-59fbb4d05d0c tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:16.798651 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-5e12ac62-c5b8-4204-b241-59fbb4d05d0c tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:16.799529 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-5e12ac62-c5b8-4204-b241-59fbb4d05d0c tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:16.799872 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-5e12ac62-c5b8-4204-b241-59fbb4d05d0c tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:16.886310 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-5e12ac62-c5b8-4204-b241-59fbb4d05d0c tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:59:16.894966 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-5e12ac62-c5b8-4204-b241-59fbb4d05d0c tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:59:16.897017 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-5e12ac62-c5b8-4204-b241-59fbb4d05d0c tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:59:16.898215 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-5e12ac62-c5b8-4204-b241-59fbb4d05d0c tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5" status: 200 len: 1344 microversion: 2.20 time: 0.111518 Aug 02 10:59:16.898973 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 266/528] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 10:59:16 2022] GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5 => generated 1344 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:59:17.921437 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-30973bcf-57d1-4c64-9e7e-0a426610549e tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:59:17.922322 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-30973bcf-57d1-4c64-9e7e-0a426610549e tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: f86a8852-12b8-46d3-bd9b-bc140757b4c5] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:59:17.929603 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-30973bcf-57d1-4c64-9e7e-0a426610549e tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:17.930056 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-30973bcf-57d1-4c64-9e7e-0a426610549e tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:17.930837 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-30973bcf-57d1-4c64-9e7e-0a426610549e tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:17.931318 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-30973bcf-57d1-4c64-9e7e-0a426610549e tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:18.062477 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-30973bcf-57d1-4c64-9e7e-0a426610549e tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:59:18.071898 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-30973bcf-57d1-4c64-9e7e-0a426610549e tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:59:18.073400 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-30973bcf-57d1-4c64-9e7e-0a426610549e tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:59:18.074507 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-30973bcf-57d1-4c64-9e7e-0a426610549e tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5" status: 200 len: 1410 microversion: 2.20 time: 0.157126 Aug 02 10:59:18.075079 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 263/529] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 10:59:17 2022] GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5 => generated 1410 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:59:18.635725 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [req-ff046411-d057-409a-a6dc-4ea33f2a0c37 req-59904e1d-b8b3-4947-83b5-cd3f16637f60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f86a8852-12b8-46d3-bd9b-bc140757b4c5", "tag": "b19c6f76-3eb2-428e-95c9-247e8c1ea7c5"}]} {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:59:18.647246 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [req-ff046411-d057-409a-a6dc-4ea33f2a0c37 req-59904e1d-b8b3-4947-83b5-cd3f16637f60 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:18.647722 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [req-ff046411-d057-409a-a6dc-4ea33f2a0c37 req-59904e1d-b8b3-4947-83b5-cd3f16637f60 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:18.651291 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG dbcounter [-] [129953] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=129953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:59:18.660262 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.compute.server_external_events [req-ff046411-d057-409a-a6dc-4ea33f2a0c37 req-59904e1d-b8b3-4947-83b5-cd3f16637f60 service nova] Creating event network-changed:b19c6f76-3eb2-428e-95c9-247e8c1ea7c5 for instance f86a8852-12b8-46d3-bd9b-bc140757b4c5 on hv-cinder-85031 Aug 02 10:59:18.665830 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [req-ff046411-d057-409a-a6dc-4ea33f2a0c37 req-59904e1d-b8b3-4947-83b5-cd3f16637f60 service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034288 Aug 02 10:59:18.666611 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 267/530] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Aug 2 10:59:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:59:19.098053 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-061493ed-6c7a-4527-97f6-33aebe275b13 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:59:19.098674 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-061493ed-6c7a-4527-97f6-33aebe275b13 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: f86a8852-12b8-46d3-bd9b-bc140757b4c5] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:59:19.106622 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-061493ed-6c7a-4527-97f6-33aebe275b13 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:19.107172 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-061493ed-6c7a-4527-97f6-33aebe275b13 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:19.108045 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-061493ed-6c7a-4527-97f6-33aebe275b13 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:19.108492 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-061493ed-6c7a-4527-97f6-33aebe275b13 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:19.248285 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-061493ed-6c7a-4527-97f6-33aebe275b13 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:59:19.257522 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-061493ed-6c7a-4527-97f6-33aebe275b13 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:59:19.259266 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-061493ed-6c7a-4527-97f6-33aebe275b13 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:59:19.260485 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-061493ed-6c7a-4527-97f6-33aebe275b13 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5" status: 200 len: 1410 microversion: 2.20 time: 0.166559 Aug 02 10:59:19.261050 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 264/531] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 10:59:19 2022] GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5 => generated 1410 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:59:20.285090 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-abc2de36-6640-4087-96f8-edaa91890473 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:59:20.285784 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-abc2de36-6640-4087-96f8-edaa91890473 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: f86a8852-12b8-46d3-bd9b-bc140757b4c5] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:59:20.293449 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-abc2de36-6640-4087-96f8-edaa91890473 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:20.293895 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-abc2de36-6640-4087-96f8-edaa91890473 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:20.294663 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-abc2de36-6640-4087-96f8-edaa91890473 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:20.295122 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-abc2de36-6640-4087-96f8-edaa91890473 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:20.432878 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-abc2de36-6640-4087-96f8-edaa91890473 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:59:20.441477 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-abc2de36-6640-4087-96f8-edaa91890473 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:59:20.442963 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-abc2de36-6640-4087-96f8-edaa91890473 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:59:20.444191 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-abc2de36-6640-4087-96f8-edaa91890473 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5" status: 200 len: 1410 microversion: 2.20 time: 0.164039 Aug 02 10:59:20.444906 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 268/532] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 10:59:20 2022] GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5 => generated 1410 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:59:21.467011 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-2a5f0669-3db4-4afd-baa1-3315b8e3e827 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:59:21.467673 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-2a5f0669-3db4-4afd-baa1-3315b8e3e827 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: f86a8852-12b8-46d3-bd9b-bc140757b4c5] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:59:21.474426 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-2a5f0669-3db4-4afd-baa1-3315b8e3e827 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:21.474881 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-2a5f0669-3db4-4afd-baa1-3315b8e3e827 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:21.475732 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-2a5f0669-3db4-4afd-baa1-3315b8e3e827 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:21.476175 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-2a5f0669-3db4-4afd-baa1-3315b8e3e827 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:21.614214 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-2a5f0669-3db4-4afd-baa1-3315b8e3e827 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:59:21.623410 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-2a5f0669-3db4-4afd-baa1-3315b8e3e827 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:59:21.624871 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-2a5f0669-3db4-4afd-baa1-3315b8e3e827 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:59:21.625984 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-2a5f0669-3db4-4afd-baa1-3315b8e3e827 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5" status: 200 len: 1410 microversion: 2.20 time: 0.162981 Aug 02 10:59:21.626593 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 265/533] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 10:59:21 2022] GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5 => generated 1410 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:59:22.649782 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-aa243ab5-692f-4cbd-a9a9-13a73af079f4 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:59:22.650418 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-aa243ab5-692f-4cbd-a9a9-13a73af079f4 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: f86a8852-12b8-46d3-bd9b-bc140757b4c5] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:59:22.658091 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-aa243ab5-692f-4cbd-a9a9-13a73af079f4 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:22.658533 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-aa243ab5-692f-4cbd-a9a9-13a73af079f4 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:22.659333 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-aa243ab5-692f-4cbd-a9a9-13a73af079f4 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:22.659765 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-aa243ab5-692f-4cbd-a9a9-13a73af079f4 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:22.802733 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-aa243ab5-692f-4cbd-a9a9-13a73af079f4 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:59:22.812031 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-aa243ab5-692f-4cbd-a9a9-13a73af079f4 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:59:22.813540 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-aa243ab5-692f-4cbd-a9a9-13a73af079f4 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:59:22.814634 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-aa243ab5-692f-4cbd-a9a9-13a73af079f4 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5" status: 200 len: 1410 microversion: 2.20 time: 0.168998 Aug 02 10:59:22.815458 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 269/534] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 10:59:22 2022] GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5 => generated 1410 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:59:23.709952 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [req-e788c370-f3f7-464c-915a-7f5ed8c65f1a req-2f97176e-c378-4bd1-9dc9-36c219711d9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f86a8852-12b8-46d3-bd9b-bc140757b4c5", "name": "network-vif-plugged", "status": "completed", "tag": "b19c6f76-3eb2-428e-95c9-247e8c1ea7c5"}]} {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:59:23.722637 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [req-e788c370-f3f7-464c-915a-7f5ed8c65f1a req-2f97176e-c378-4bd1-9dc9-36c219711d9f service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:23.723634 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [req-e788c370-f3f7-464c-915a-7f5ed8c65f1a req-2f97176e-c378-4bd1-9dc9-36c219711d9f service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:23.735365 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.compute.server_external_events [req-e788c370-f3f7-464c-915a-7f5ed8c65f1a req-2f97176e-c378-4bd1-9dc9-36c219711d9f service nova] Creating event network-vif-plugged:b19c6f76-3eb2-428e-95c9-247e8c1ea7c5 for instance f86a8852-12b8-46d3-bd9b-bc140757b4c5 on hv-cinder-85031 Aug 02 10:59:23.740702 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [req-e788c370-f3f7-464c-915a-7f5ed8c65f1a req-2f97176e-c378-4bd1-9dc9-36c219711d9f service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035380 Aug 02 10:59:23.741589 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 266/535] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Aug 2 10:59:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:59:23.840940 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-2a81bedb-41ed-4475-a303-0c39f6db2c2b tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:59:23.841571 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-2a81bedb-41ed-4475-a303-0c39f6db2c2b tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: f86a8852-12b8-46d3-bd9b-bc140757b4c5] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:59:23.848845 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-2a81bedb-41ed-4475-a303-0c39f6db2c2b tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:23.849287 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-2a81bedb-41ed-4475-a303-0c39f6db2c2b tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:23.850155 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-2a81bedb-41ed-4475-a303-0c39f6db2c2b tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:23.850583 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-2a81bedb-41ed-4475-a303-0c39f6db2c2b tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:24.095292 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-2a81bedb-41ed-4475-a303-0c39f6db2c2b tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:59:24.095292 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-2a81bedb-41ed-4475-a303-0c39f6db2c2b tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:59:24.095835 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-2a81bedb-41ed-4475-a303-0c39f6db2c2b tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:59:24.095835 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-2a81bedb-41ed-4475-a303-0c39f6db2c2b tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5" status: 200 len: 1410 microversion: 2.20 time: 0.174026 Aug 02 10:59:24.095835 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 270/536] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 10:59:23 2022] GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5 => generated 1410 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 10:59:25.034289 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-d8b47541-7ca8-4eec-9688-a6d45d52a171 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:59:25.035144 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-d8b47541-7ca8-4eec-9688-a6d45d52a171 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: f86a8852-12b8-46d3-bd9b-bc140757b4c5] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:59:25.037126 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG dbcounter [-] [129952] Writing DB stats nova_cell0:SELECT=2 {{(pid=129952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:59:25.038642 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG dbcounter [-] [129952] Writing DB stats nova_cell0:SELECT=6 {{(pid=129952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:59:25.047294 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-d8b47541-7ca8-4eec-9688-a6d45d52a171 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:25.051151 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-d8b47541-7ca8-4eec-9688-a6d45d52a171 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:25.051151 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-d8b47541-7ca8-4eec-9688-a6d45d52a171 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:25.051151 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-d8b47541-7ca8-4eec-9688-a6d45d52a171 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:25.185265 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-d8b47541-7ca8-4eec-9688-a6d45d52a171 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:59:25.193350 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-d8b47541-7ca8-4eec-9688-a6d45d52a171 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:59:25.195031 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-d8b47541-7ca8-4eec-9688-a6d45d52a171 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:59:25.196151 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-d8b47541-7ca8-4eec-9688-a6d45d52a171 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5" status: 200 len: 1410 microversion: 2.20 time: 0.166522 Aug 02 10:59:25.196707 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 267/537] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 10:59:25 2022] GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5 => generated 1410 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:59:26.219675 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-39c2d6b4-5cd0-4520-8d0b-59936de2bcba tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:59:26.220289 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-39c2d6b4-5cd0-4520-8d0b-59936de2bcba tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: f86a8852-12b8-46d3-bd9b-bc140757b4c5] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:59:26.222239 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG dbcounter [-] [129953] Writing DB stats nova_cell0:SELECT=6 {{(pid=129953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:59:26.227937 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-39c2d6b4-5cd0-4520-8d0b-59936de2bcba tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:26.228426 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-39c2d6b4-5cd0-4520-8d0b-59936de2bcba tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:26.229191 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-39c2d6b4-5cd0-4520-8d0b-59936de2bcba tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:26.229622 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-39c2d6b4-5cd0-4520-8d0b-59936de2bcba tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:26.363819 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-39c2d6b4-5cd0-4520-8d0b-59936de2bcba tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:59:26.372392 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-39c2d6b4-5cd0-4520-8d0b-59936de2bcba tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:59:26.374030 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-39c2d6b4-5cd0-4520-8d0b-59936de2bcba tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:59:26.375175 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-39c2d6b4-5cd0-4520-8d0b-59936de2bcba tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5" status: 200 len: 1410 microversion: 2.20 time: 0.159430 Aug 02 10:59:26.375742 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 271/538] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 10:59:26 2022] GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5 => generated 1410 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:59:27.401250 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-ccfaf4ec-117b-40c8-9381-9db22dd66637 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:59:27.401894 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-ccfaf4ec-117b-40c8-9381-9db22dd66637 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: f86a8852-12b8-46d3-bd9b-bc140757b4c5] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:59:27.408866 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-ccfaf4ec-117b-40c8-9381-9db22dd66637 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:27.409314 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-ccfaf4ec-117b-40c8-9381-9db22dd66637 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:27.410114 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-ccfaf4ec-117b-40c8-9381-9db22dd66637 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:27.410597 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-ccfaf4ec-117b-40c8-9381-9db22dd66637 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:27.544723 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-ccfaf4ec-117b-40c8-9381-9db22dd66637 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:59:27.552831 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-ccfaf4ec-117b-40c8-9381-9db22dd66637 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:59:27.554396 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-ccfaf4ec-117b-40c8-9381-9db22dd66637 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:59:27.555586 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-ccfaf4ec-117b-40c8-9381-9db22dd66637 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5" status: 200 len: 1602 microversion: 2.20 time: 0.158960 Aug 02 10:59:27.556148 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 268/539] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 10:59:27 2022] GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5 => generated 1602 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 10:59:27.577913 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-ad2bf425-75b0-4ea6-af27-67c0f574a635 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:59:27.578431 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-ad2bf425-75b0-4ea6-af27-67c0f574a635 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: f86a8852-12b8-46d3-bd9b-bc140757b4c5] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:59:27.584931 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-ad2bf425-75b0-4ea6-af27-67c0f574a635 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:27.585422 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-ad2bf425-75b0-4ea6-af27-67c0f574a635 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:27.586941 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-ad2bf425-75b0-4ea6-af27-67c0f574a635 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:27.587441 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-ad2bf425-75b0-4ea6-af27-67c0f574a635 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:27.666761 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-ad2bf425-75b0-4ea6-af27-67c0f574a635 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.092668 Aug 02 10:59:27.667414 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 272/540] 10.222.0.115 () {60 vars in 1321 bytes} [Tue Aug 2 10:59:27 2022] GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 10:59:28.664707 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [req-81b8f44b-a6ad-4651-86bc-ff5aab343b85 req-b1f123ca-5d36-4852-a1fe-61c34e538883 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f86a8852-12b8-46d3-bd9b-bc140757b4c5", "tag": "b19c6f76-3eb2-428e-95c9-247e8c1ea7c5"}]} {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:59:28.674474 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [req-81b8f44b-a6ad-4651-86bc-ff5aab343b85 req-b1f123ca-5d36-4852-a1fe-61c34e538883 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:28.674910 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [req-81b8f44b-a6ad-4651-86bc-ff5aab343b85 req-b1f123ca-5d36-4852-a1fe-61c34e538883 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:28.689161 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.compute.server_external_events [req-81b8f44b-a6ad-4651-86bc-ff5aab343b85 req-b1f123ca-5d36-4852-a1fe-61c34e538883 service nova] Creating event network-changed:b19c6f76-3eb2-428e-95c9-247e8c1ea7c5 for instance f86a8852-12b8-46d3-bd9b-bc140757b4c5 on hv-cinder-85031 Aug 02 10:59:28.694127 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [req-81b8f44b-a6ad-4651-86bc-ff5aab343b85 req-b1f123ca-5d36-4852-a1fe-61c34e538883 service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033253 Aug 02 10:59:28.694739 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 269/541] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Aug 2 10:59:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:59:38.523345 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG dbcounter [-] [129953] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=1 {{(pid=129953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:59:38.524696 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG dbcounter [-] [129953] Writing DB stats nova_cell1:SELECT=29 {{(pid=129953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:59:38.528677 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-23708c9c-aeb1-41f5-9508-e27ea8a0d13f tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:59:38.529162 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-23708c9c-aeb1-41f5-9508-e27ea8a0d13f tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: a780ca09-3975-44eb-9464-355460c10686] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:59:38.535618 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-23708c9c-aeb1-41f5-9508-e27ea8a0d13f tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:38.540306 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-23708c9c-aeb1-41f5-9508-e27ea8a0d13f tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:38.540306 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-23708c9c-aeb1-41f5-9508-e27ea8a0d13f tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:38.540306 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-23708c9c-aeb1-41f5-9508-e27ea8a0d13f tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:38.561238 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-23708c9c-aeb1-41f5-9508-e27ea8a0d13f tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "GET /compute/v2.1/servers/a780ca09-3975-44eb-9464-355460c10686/ips" status: 200 len: 149 microversion: 2.1 time: 0.039265 Aug 02 10:59:38.563067 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 273/542] 10.222.0.115 () {58 vars in 1253 bytes} [Tue Aug 2 10:59:38 2022] GET /compute/v2.1/servers/a780ca09-3975-44eb-9464-355460c10686/ips => generated 149 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:59:39.369938 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-70c61bfe-a193-43fa-9842-8763faf57828 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "82f4a931-697f-48ed-9700-45cd2f48f1a1"}} {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:59:39.372380 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-70c61bfe-a193-43fa-9842-8763faf57828 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:59:39.374983 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG dbcounter [-] [129952] Writing DB stats nova_api:SELECT=47,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=129952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:59:39.375658 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG dbcounter [-] [129952] Writing DB stats nova_cell1:SELECT=76 {{(pid=129952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:59:39.380986 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-70c61bfe-a193-43fa-9842-8763faf57828 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:39.381458 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-70c61bfe-a193-43fa-9842-8763faf57828 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:39.382217 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-70c61bfe-a193-43fa-9842-8763faf57828 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:39.382645 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-70c61bfe-a193-43fa-9842-8763faf57828 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:40.317389 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-70c61bfe-a193-43fa-9842-8763faf57828 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "POST /compute/v2.1/servers/8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.906840 Aug 02 10:59:40.317389 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 270/543] 10.222.0.115 () {60 vars in 1328 bytes} [Tue Aug 2 10:59:39 2022] POST /compute/v2.1/servers/8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a/os-volume_attachments => generated 194 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:59:40.318218 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-75158e33-ecad-418e-9d91-4747063d5369 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6ac5f41e-f16e-4d5d-bb7c-4b0ead23e673"}} {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:59:40.318218 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-75158e33-ecad-418e-9d91-4747063d5369 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: a780ca09-3975-44eb-9464-355460c10686] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:59:40.318218 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-75158e33-ecad-418e-9d91-4747063d5369 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:40.318218 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-75158e33-ecad-418e-9d91-4747063d5369 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:40.318979 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-75158e33-ecad-418e-9d91-4747063d5369 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:40.318979 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-75158e33-ecad-418e-9d91-4747063d5369 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:41.128102 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-75158e33-ecad-418e-9d91-4747063d5369 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "POST /compute/v2.1/servers/a780ca09-3975-44eb-9464-355460c10686/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.840899 Aug 02 10:59:41.128808 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 274/544] 10.222.0.115 () {60 vars in 1328 bytes} [Tue Aug 2 10:59:40 2022] POST /compute/v2.1/servers/a780ca09-3975-44eb-9464-355460c10686/os-volume_attachments => generated 194 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:59:45.332345 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-58bf324c-6b22-4f9f-8c29-f00d6b049ee6 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:59:45.334670 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-58bf324c-6b22-4f9f-8c29-f00d6b049ee6 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] [instance: 3938932a-e778-4c0c-9ab0-78dc9082a48e] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:59:45.341356 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-58bf324c-6b22-4f9f-8c29-f00d6b049ee6 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:45.341801 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-58bf324c-6b22-4f9f-8c29-f00d6b049ee6 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:45.342606 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-58bf324c-6b22-4f9f-8c29-f00d6b049ee6 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:45.343064 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-58bf324c-6b22-4f9f-8c29-f00d6b049ee6 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:45.373562 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-58bf324c-6b22-4f9f-8c29-f00d6b049ee6 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] 10.222.0.115 "GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046375 Aug 02 10:59:45.374133 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 271/545] 10.222.0.115 () {58 vars in 1307 bytes} [Tue Aug 2 10:59:45 2022] GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 02 10:59:45.440885 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-74c08aaa-bc40-4516-85b5-20baa6537b53 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:59:45.441470 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-74c08aaa-bc40-4516-85b5-20baa6537b53 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] [instance: 3938932a-e778-4c0c-9ab0-78dc9082a48e] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:59:45.448755 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-74c08aaa-bc40-4516-85b5-20baa6537b53 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:45.450250 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-74c08aaa-bc40-4516-85b5-20baa6537b53 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:45.450250 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-74c08aaa-bc40-4516-85b5-20baa6537b53 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:45.450515 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-74c08aaa-bc40-4516-85b5-20baa6537b53 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:45.476051 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-74c08aaa-bc40-4516-85b5-20baa6537b53 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] [instance: 3938932a-e778-4c0c-9ab0-78dc9082a48e] Going to try to terminate instance {{(pid=129953) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 10:59:45.746929 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-74c08aaa-bc40-4516-85b5-20baa6537b53 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] 10.222.0.115 "DELETE /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e" status: 204 len: 0 microversion: 2.1 time: 0.310418 Aug 02 10:59:45.747591 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 275/546] 10.222.0.115 () {58 vars in 1244 bytes} [Tue Aug 2 10:59:45 2022] DELETE /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 10:59:45.756006 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-5dde144b-13ee-4d89-8009-069eff812455 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:59:45.756626 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-5dde144b-13ee-4d89-8009-069eff812455 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] [instance: 3938932a-e778-4c0c-9ab0-78dc9082a48e] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:59:45.762736 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-5dde144b-13ee-4d89-8009-069eff812455 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:45.763230 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-5dde144b-13ee-4d89-8009-069eff812455 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:45.764002 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-5dde144b-13ee-4d89-8009-069eff812455 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:45.764437 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-5dde144b-13ee-4d89-8009-069eff812455 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:45.895922 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-5dde144b-13ee-4d89-8009-069eff812455 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f41f17f5154e01a699043edc350cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e92110a1545f1b84644b8971bb6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:59:45.904501 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-5dde144b-13ee-4d89-8009-069eff812455 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] 10.222.0.115 "GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e" status: 200 len: 1675 microversion: 2.1 time: 0.152339 Aug 02 10:59:45.905055 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 272/547] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:59:45 2022] GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e => generated 1675 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:59:46.927218 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-358032c4-7364-4254-89b7-842bc32a4d70 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:59:46.927917 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-358032c4-7364-4254-89b7-842bc32a4d70 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] [instance: 3938932a-e778-4c0c-9ab0-78dc9082a48e] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:59:46.934573 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-358032c4-7364-4254-89b7-842bc32a4d70 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:46.935023 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-358032c4-7364-4254-89b7-842bc32a4d70 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:46.935821 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-358032c4-7364-4254-89b7-842bc32a4d70 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:46.936259 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-358032c4-7364-4254-89b7-842bc32a4d70 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:47.069955 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-358032c4-7364-4254-89b7-842bc32a4d70 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f41f17f5154e01a699043edc350cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e92110a1545f1b84644b8971bb6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:59:47.077738 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-358032c4-7364-4254-89b7-842bc32a4d70 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] 10.222.0.115 "GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e" status: 200 len: 1675 microversion: 2.1 time: 0.154826 Aug 02 10:59:47.078304 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 276/548] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:59:46 2022] GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e => generated 1675 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:59:48.099202 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-b7e28326-335a-4f4a-bb22-504be3543369 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:59:48.099823 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-b7e28326-335a-4f4a-bb22-504be3543369 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] [instance: 3938932a-e778-4c0c-9ab0-78dc9082a48e] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:59:48.106715 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-b7e28326-335a-4f4a-bb22-504be3543369 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:48.107200 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-b7e28326-335a-4f4a-bb22-504be3543369 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:48.107969 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-b7e28326-335a-4f4a-bb22-504be3543369 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:48.108406 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-b7e28326-335a-4f4a-bb22-504be3543369 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:48.243710 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-b7e28326-335a-4f4a-bb22-504be3543369 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f41f17f5154e01a699043edc350cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e92110a1545f1b84644b8971bb6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:59:48.252247 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-b7e28326-335a-4f4a-bb22-504be3543369 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] 10.222.0.115 "GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e" status: 200 len: 1675 microversion: 2.1 time: 0.156828 Aug 02 10:59:48.252828 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 273/549] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:59:48 2022] GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e => generated 1675 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:59:49.162203 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [req-52acea05-c662-409f-b9a1-e66b4f9f7a27 req-78539478-2e5e-4b89-ad5b-f66c3962f7a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3938932a-e778-4c0c-9ab0-78dc9082a48e", "name": "network-vif-deleted", "tag": "9f11ec7a-3435-4709-afef-46942fe71fcf"}]} {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:59:49.174848 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [req-52acea05-c662-409f-b9a1-e66b4f9f7a27 req-78539478-2e5e-4b89-ad5b-f66c3962f7a6 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:49.175337 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [req-52acea05-c662-409f-b9a1-e66b4f9f7a27 req-78539478-2e5e-4b89-ad5b-f66c3962f7a6 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:49.187777 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.compute.server_external_events [req-52acea05-c662-409f-b9a1-e66b4f9f7a27 req-78539478-2e5e-4b89-ad5b-f66c3962f7a6 service nova] Creating event network-vif-deleted:9f11ec7a-3435-4709-afef-46942fe71fcf for instance 3938932a-e778-4c0c-9ab0-78dc9082a48e on hv-cinder-85031 Aug 02 10:59:49.192973 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [req-52acea05-c662-409f-b9a1-e66b4f9f7a27 req-78539478-2e5e-4b89-ad5b-f66c3962f7a6 service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034923 Aug 02 10:59:49.194222 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 277/550] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Aug 2 10:59:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:59:49.276123 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-8c4b7dec-cef4-4bbd-850a-183b0696e90f tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:59:49.277000 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-8c4b7dec-cef4-4bbd-850a-183b0696e90f tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] [instance: 3938932a-e778-4c0c-9ab0-78dc9082a48e] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:59:49.284539 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-8c4b7dec-cef4-4bbd-850a-183b0696e90f tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:49.285270 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-8c4b7dec-cef4-4bbd-850a-183b0696e90f tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:49.287448 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-8c4b7dec-cef4-4bbd-850a-183b0696e90f tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:49.288151 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-8c4b7dec-cef4-4bbd-850a-183b0696e90f tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:49.367841 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-8c4b7dec-cef4-4bbd-850a-183b0696e90f tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f41f17f5154e01a699043edc350cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e92110a1545f1b84644b8971bb6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:59:49.376702 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-8c4b7dec-cef4-4bbd-850a-183b0696e90f tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] 10.222.0.115 "GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e" status: 200 len: 1608 microversion: 2.1 time: 0.105073 Aug 02 10:59:49.378614 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 274/551] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:59:49 2022] GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e => generated 1608 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:59:49.941614 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-7b4b54f5-cbea-4981-9b59-ae80d7d34eea tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:59:49.944164 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-7b4b54f5-cbea-4981-9b59-ae80d7d34eea tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:59:49.954025 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-7b4b54f5-cbea-4981-9b59-ae80d7d34eea tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:49.954025 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-7b4b54f5-cbea-4981-9b59-ae80d7d34eea tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:49.954025 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-7b4b54f5-cbea-4981-9b59-ae80d7d34eea tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:49.954025 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-7b4b54f5-cbea-4981-9b59-ae80d7d34eea tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:49.979661 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.objects.instance [None req-7b4b54f5-cbea-4981-9b59-ae80d7d34eea tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lazy-loading 'flavor' on Instance uuid 8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a {{(pid=129953) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 10:59:50.352100 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-7b4b54f5-cbea-4981-9b59-ae80d7d34eea tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "POST /compute/v2.1/servers/8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a/action" status: 200 len: 32 microversion: 2.1 time: 0.414931 Aug 02 10:59:50.352724 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 278/552] 10.222.0.115 () {60 vars in 1283 bytes} [Tue Aug 2 10:59:49 2022] POST /compute/v2.1/servers/8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a/action => generated 32 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 10:59:50.363747 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-6bf939de-9cc4-4b45-86f6-e4c8af822386 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:59:50.365276 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-6bf939de-9cc4-4b45-86f6-e4c8af822386 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:59:50.373504 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-6bf939de-9cc4-4b45-86f6-e4c8af822386 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:50.373953 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-6bf939de-9cc4-4b45-86f6-e4c8af822386 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:50.374760 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-6bf939de-9cc4-4b45-86f6-e4c8af822386 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:50.375254 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-6bf939de-9cc4-4b45-86f6-e4c8af822386 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:50.401035 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-3ac45388-b0e6-4170-a01c-a0e3e7951978 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:59:50.401727 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-3ac45388-b0e6-4170-a01c-a0e3e7951978 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] [instance: 3938932a-e778-4c0c-9ab0-78dc9082a48e] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:59:50.408348 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-3ac45388-b0e6-4170-a01c-a0e3e7951978 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:50.408756 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-3ac45388-b0e6-4170-a01c-a0e3e7951978 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:50.409613 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-3ac45388-b0e6-4170-a01c-a0e3e7951978 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:50.410064 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-3ac45388-b0e6-4170-a01c-a0e3e7951978 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:50.426082 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.wsgi [None req-3ac45388-b0e6-4170-a01c-a0e3e7951978 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] HTTP exception thrown: Instance 3938932a-e778-4c0c-9ab0-78dc9082a48e could not be found. Aug 02 10:59:50.427737 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-3ac45388-b0e6-4170-a01c-a0e3e7951978 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Request method failure captured: Aug 02 10:59:50.427737 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: request: GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e HTTP/1.1 Aug 02 10:59:50.427737 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Accept: application/json Aug 02 10:59:50.427737 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Accept-Encoding: identity Aug 02 10:59:50.427737 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Connection: close Aug 02 10:59:50.427737 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Content-Length: 0 Aug 02 10:59:50.427737 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Content-Type: application/json Aug 02 10:59:50.427737 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Host: 10.222.0.115 Aug 02 10:59:50.427737 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Openstack-System-Scope: None Aug 02 10:59:50.427737 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: User-Agent: python-urllib3/1.26.10 Aug 02 10:59:50.427737 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Auth-Token: gAAAAABi6QKP2ZooXwKqX5KvPH3An3wyIoIsMgqpY1U6hmfsdfbyQPM8SwHstppNJS_IdskheOf_4r6IRhjVVcUg3tpKtkcShi4vzFBP96Mmoq9msduhL-i8w55s44Ke6IYK5jxLjLnFmn9xEdrciTrqBmIOO8O7BC5NmiD-a-j9BHWvNFOt1U0 Aug 02 10:59:50.427737 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Domain-Id: None Aug 02 10:59:50.427737 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Domain-Name: None Aug 02 10:59:50.427737 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Identity-Status: Confirmed Aug 02 10:59:50.427737 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Is-Admin-Project: True Aug 02 10:59:50.427737 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Project-Domain-Id: default Aug 02 10:59:50.427737 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Project-Domain-Name: Default Aug 02 10:59:50.427737 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Project-Id: 302e92110a1545f1b84644b8971bb6eb Aug 02 10:59:50.427737 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Project-Name: tempest-AttachVolumeTestJSON-322964104 Aug 02 10:59:50.427737 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Role: reader,member Aug 02 10:59:50.427737 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Roles: reader,member Aug 02 10:59:50.429403 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/302e92110a1545f1b84644b8971bb6eb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2/302e92110a1545f1b84644b8971bb6eb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/302e92110a1545f1b84644b8971bb6eb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.115:8080", "publicURL": "http://10.222.0.115:8080/v1/AUTH_302e92110a1545f1b84644b8971bb6eb"}]}] Aug 02 10:59:50.429403 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Tenant: tempest-AttachVolumeTestJSON-322964104 Aug 02 10:59:50.429403 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Tenant-Id: 302e92110a1545f1b84644b8971bb6eb Aug 02 10:59:50.429403 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Tenant-Name: tempest-AttachVolumeTestJSON-322964104 Aug 02 10:59:50.429403 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User: tempest-AttachVolumeTestJSON-322964104-project Aug 02 10:59:50.429403 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User-Domain-Id: default Aug 02 10:59:50.429403 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User-Domain-Name: Default Aug 02 10:59:50.429403 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User-Id: f3f41f17f5154e01a699043edc350cf8 Aug 02 10:59:50.429403 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User-Name: tempest-AttachVolumeTestJSON-322964104-project Aug 02 10:59:50.429403 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: method: > Aug 02 10:59:50.429403 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: exception: Instance 3938932a-e778-4c0c-9ab0-78dc9082a48e could not be found. Aug 02 10:59:50.429403 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: action_args: {'id': '3938932a-e778-4c0c-9ab0-78dc9082a48e'} Aug 02 10:59:50.430574 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:59:50.430574 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:59:50.430574 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 10:59:50.430574 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 10:59:50.430574 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 10:59:50.430574 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 10:59:50.430574 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 10:59:50.430574 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 10:59:50.430574 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 10:59:50.430574 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 10:59:50.430574 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3938932a-e778-4c0c-9ab0-78dc9082a48e could not be found. Aug 02 10:59:50.430574 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 10:59:50.430574 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:59:50.430574 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 10:59:50.430574 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:59:50.430574 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:59:50.430574 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:59:50.430574 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:59:50.430574 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:59:50.430574 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:59:50.432927 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:59:50.432927 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 10:59:50.432927 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 10:59:50.432927 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 10:59:50.432927 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 10:59:50.432927 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 10:59:50.432927 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 10:59:50.432927 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3938932a-e778-4c0c-9ab0-78dc9082a48e could not be found. Aug 02 10:59:50.432927 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 10:59:50.432927 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:59:50.432927 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 10:59:50.432927 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:59:50.432927 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:59:50.432927 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:59:50.432927 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:59:50.432927 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:59:50.432927 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3938932a-e778-4c0c-9ab0-78dc9082a48e could not be found. Aug 02 10:59:50.432927 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 10:59:50.434328 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-3ac45388-b0e6-4170-a01c-a0e3e7951978 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Returning 404 to user: Instance 3938932a-e778-4c0c-9ab0-78dc9082a48e could not be found. {{(pid=129953) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:59:50.434328 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-3ac45388-b0e6-4170-a01c-a0e3e7951978 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] 10.222.0.115 "GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e" status: 404 len: 111 microversion: 2.1 time: 0.032599 Aug 02 10:59:50.434328 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 279/553] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:59:50 2022] GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 02 10:59:50.438692 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-62acda2f-0b6c-49d4-a96c-cc01bf6d22fd tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Calling method '.version_select at 0x7f7c4e656c10>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:59:50.521115 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-6bf939de-9cc4-4b45-86f6-e4c8af822386 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:59:50.529461 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-6bf939de-9cc4-4b45-86f6-e4c8af822386 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a" status: 200 len: 1740 microversion: 2.1 time: 0.169667 Aug 02 10:59:50.530132 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 275/554] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:59:50 2022] GET /compute/v2.1/servers/8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a => generated 1740 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:59:50.542018 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-62acda2f-0b6c-49d4-a96c-cc01bf6d22fd tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] 10.222.0.115 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-932821761" status: 202 len: 0 microversion: 2.1 time: 0.106989 Aug 02 10:59:50.542628 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 280/555] 10.222.0.115 () {58 vars in 1223 bytes} [Tue Aug 2 10:59:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-932821761 => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 10:59:51.456603 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-7a0d1285-2e8b-4729-8a09-fe5299d3b0ba tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Action: 'create', calling method: .version_select at 0x7f7c4ed94040>, body: {"keypair": {"name": "tempest-keypair-682001819", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGgSJVSSaOOdbxqeaAPe/zi1q32ZpqSenRd3SzhNmxkiHznP7xlqZpiThNBUzIQoKgxkx3ftUvwWQuwwUIUU4Z/GT8910E+PlnoUwPF6hF9Avq44VZLBAhxvtlkGMj66Xg=="}} {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:59:51.472963 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.quota [None req-7a0d1285-2e8b-4729-8a09-fe5299d3b0ba tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Getting quotas for project 302e92110a1545f1b84644b8971bb6eb. Resources: {'key_pairs'} {{(pid=129952) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 10:59:51.476867 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.quota [None req-7a0d1285-2e8b-4729-8a09-fe5299d3b0ba tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Getting quotas for user f3f41f17f5154e01a699043edc350cf8 and project 302e92110a1545f1b84644b8971bb6eb. Resources: {'key_pairs'} {{(pid=129952) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 10:59:51.544061 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-7a0d1285-2e8b-4729-8a09-fe5299d3b0ba tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] 10.222.0.115 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.091327 Aug 02 10:59:51.544655 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 276/556] 10.222.0.115 () {60 vars in 1164 bytes} [Tue Aug 2 10:59:51 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:59:51.557105 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-4225bfd7-2737-4339-b867-a9f4b72e54cb tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:59:51.557105 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-4225bfd7-2737-4339-b867-a9f4b72e54cb tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:59:51.560065 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-4225bfd7-2737-4339-b867-a9f4b72e54cb tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:51.560514 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-4225bfd7-2737-4339-b867-a9f4b72e54cb tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:51.561308 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-4225bfd7-2737-4339-b867-a9f4b72e54cb tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:51.561742 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-4225bfd7-2737-4339-b867-a9f4b72e54cb tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:51.728739 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-4225bfd7-2737-4339-b867-a9f4b72e54cb tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:59:51.737298 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-4225bfd7-2737-4339-b867-a9f4b72e54cb tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a" status: 200 len: 1740 microversion: 2.1 time: 0.190380 Aug 02 10:59:51.737848 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 281/557] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:59:51 2022] GET /compute/v2.1/servers/8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a => generated 1740 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:59:52.759360 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-d9d1d3c6-78d6-4816-a667-a7b56ec0758e tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:59:52.760116 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-d9d1d3c6-78d6-4816-a667-a7b56ec0758e tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:59:52.766913 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-d9d1d3c6-78d6-4816-a667-a7b56ec0758e tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:52.767399 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-d9d1d3c6-78d6-4816-a667-a7b56ec0758e tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:52.768246 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-d9d1d3c6-78d6-4816-a667-a7b56ec0758e tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:52.768627 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-d9d1d3c6-78d6-4816-a667-a7b56ec0758e tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:53.115963 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-d9d1d3c6-78d6-4816-a667-a7b56ec0758e tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:59:53.124802 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-d9d1d3c6-78d6-4816-a667-a7b56ec0758e tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a" status: 200 len: 1740 microversion: 2.1 time: 0.369837 Aug 02 10:59:53.125475 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 277/558] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:59:52 2022] GET /compute/v2.1/servers/8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a => generated 1740 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:59:54.146097 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-25f7b3bd-f39e-4082-94f4-d072e1698d38 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:59:54.146708 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-25f7b3bd-f39e-4082-94f4-d072e1698d38 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:59:54.153548 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-25f7b3bd-f39e-4082-94f4-d072e1698d38 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:54.165240 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-25f7b3bd-f39e-4082-94f4-d072e1698d38 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:54.165240 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-25f7b3bd-f39e-4082-94f4-d072e1698d38 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:54.165240 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-25f7b3bd-f39e-4082-94f4-d072e1698d38 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:54.212740 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-f1410190-0391-4bc8-92a1-a6902203299f tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-652445403", "imageRef": "aa0a7b8c-0dd6-4803-8767-cb8c2d05fdd4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6fe1227a-df5a-435e-ae6a-6d39b8b26123"}], "security_groups": [{"name": "tempest-securitygroup--609748151"}], "key_name": "tempest-keypair-682001819", "user_data": "}} {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:59:54.365167 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.network.neutron [None req-f1410190-0391-4bc8-92a1-a6902203299f tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] validate_networks() for [('6fe1227a-df5a-435e-ae6a-6d39b8b26123', None, None, None, None, None)] {{(pid=129952) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 10:59:54.373654 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-25f7b3bd-f39e-4082-94f4-d072e1698d38 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:59:54.381699 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-25f7b3bd-f39e-4082-94f4-d072e1698d38 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a" status: 200 len: 1740 microversion: 2.1 time: 0.239652 Aug 02 10:59:54.382268 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 282/559] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:59:54 2022] GET /compute/v2.1/servers/8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a => generated 1740 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:59:54.746344 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.virt.hardware [None req-f1410190-0391-4bc8-92a1-a6902203299f tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Flavor limits 0:0:0 {{(pid=129952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 10:59:54.746771 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.virt.hardware [None req-f1410190-0391-4bc8-92a1-a6902203299f tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Image limits 0:0:0 {{(pid=129952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 10:59:54.747305 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.virt.hardware [None req-f1410190-0391-4bc8-92a1-a6902203299f tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Flavor pref 0:0:0 {{(pid=129952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 10:59:54.747716 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.virt.hardware [None req-f1410190-0391-4bc8-92a1-a6902203299f tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Image pref 0:0:0 {{(pid=129952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 10:59:54.748129 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.virt.hardware [None req-f1410190-0391-4bc8-92a1-a6902203299f tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 10:59:54.757087 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-f1410190-0391-4bc8-92a1-a6902203299f tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:54.757535 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-f1410190-0391-4bc8-92a1-a6902203299f tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:54.758337 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-f1410190-0391-4bc8-92a1-a6902203299f tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:54.758775 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-f1410190-0391-4bc8-92a1-a6902203299f tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:54.775031 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.quota [None req-f1410190-0391-4bc8-92a1-a6902203299f tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Getting quotas for project 302e92110a1545f1b84644b8971bb6eb. Resources: {'instances', 'cores', 'ram'} {{(pid=129952) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 10:59:54.779191 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.quota [None req-f1410190-0391-4bc8-92a1-a6902203299f tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Getting quotas for user f3f41f17f5154e01a699043edc350cf8 and project 302e92110a1545f1b84644b8971bb6eb. Resources: {'instances', 'cores', 'ram'} {{(pid=129952) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 10:59:54.790020 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-f1410190-0391-4bc8-92a1-a6902203299f tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Going to run 1 instances... {{(pid=129952) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 10:59:54.792928 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-f1410190-0391-4bc8-92a1-a6902203299f tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] [instance: 93775f02-e62c-4392-a1ed-cfd5dd956dd7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aa0a7b8c-0dd6-4803-8767-cb8c2d05fdd4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129952) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 10:59:54.944883 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-f1410190-0391-4bc8-92a1-a6902203299f tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] 10.222.0.115 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.736390 Aug 02 10:59:54.945379 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 278/560] 10.222.0.115 () {60 vars in 1152 bytes} [Tue Aug 2 10:59:54 2022] POST /compute/v2.1/servers => generated 403 bytes in 738 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Aug 02 10:59:54.956231 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-ad3315ca-e1a1-43ca-ae74-afc3b629706d tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:59:54.956872 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-ad3315ca-e1a1-43ca-ae74-afc3b629706d tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] [instance: 93775f02-e62c-4392-a1ed-cfd5dd956dd7] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:59:55.016023 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-ad3315ca-e1a1-43ca-ae74-afc3b629706d tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f41f17f5154e01a699043edc350cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e92110a1545f1b84644b8971bb6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:59:55.023267 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-ad3315ca-e1a1-43ca-ae74-afc3b629706d tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] 10.222.0.115 "GET /compute/v2.1/servers/93775f02-e62c-4392-a1ed-cfd5dd956dd7" status: 200 len: 1240 microversion: 2.1 time: 0.070816 Aug 02 10:59:55.023829 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 283/561] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:59:54 2022] GET /compute/v2.1/servers/93775f02-e62c-4392-a1ed-cfd5dd956dd7 => generated 1240 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:59:55.404364 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-8a6c3f67-26da-4bf1-ab43-2aaee1ba14a8 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:59:55.405826 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-8a6c3f67-26da-4bf1-ab43-2aaee1ba14a8 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:59:55.414427 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-8a6c3f67-26da-4bf1-ab43-2aaee1ba14a8 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:55.414937 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-8a6c3f67-26da-4bf1-ab43-2aaee1ba14a8 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:55.416354 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-8a6c3f67-26da-4bf1-ab43-2aaee1ba14a8 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:55.416824 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-8a6c3f67-26da-4bf1-ab43-2aaee1ba14a8 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:55.553167 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-8a6c3f67-26da-4bf1-ab43-2aaee1ba14a8 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:59:55.562503 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-8a6c3f67-26da-4bf1-ab43-2aaee1ba14a8 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a" status: 200 len: 1740 microversion: 2.1 time: 0.163124 Aug 02 10:59:55.563109 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 279/562] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:59:55 2022] GET /compute/v2.1/servers/8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a => generated 1740 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:59:56.046990 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-ecbc0552-8926-41b0-8e80-e70e6d9f6d1a tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:59:56.047653 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-ecbc0552-8926-41b0-8e80-e70e6d9f6d1a tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] [instance: 93775f02-e62c-4392-a1ed-cfd5dd956dd7] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:59:56.054325 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-ecbc0552-8926-41b0-8e80-e70e6d9f6d1a tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:56.054785 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-ecbc0552-8926-41b0-8e80-e70e6d9f6d1a tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:56.055578 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-ecbc0552-8926-41b0-8e80-e70e6d9f6d1a tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:56.056723 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-ecbc0552-8926-41b0-8e80-e70e6d9f6d1a tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:56.122252 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-ecbc0552-8926-41b0-8e80-e70e6d9f6d1a tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f41f17f5154e01a699043edc350cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e92110a1545f1b84644b8971bb6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:59:56.130086 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-ecbc0552-8926-41b0-8e80-e70e6d9f6d1a tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] 10.222.0.115 "GET /compute/v2.1/servers/93775f02-e62c-4392-a1ed-cfd5dd956dd7" status: 200 len: 1244 microversion: 2.1 time: 0.087094 Aug 02 10:59:56.130656 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 284/563] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:59:56 2022] GET /compute/v2.1/servers/93775f02-e62c-4392-a1ed-cfd5dd956dd7 => generated 1244 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:59:56.587805 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-28179e40-4129-4301-b14d-60ca17486e90 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:59:56.589731 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-28179e40-4129-4301-b14d-60ca17486e90 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:59:56.596962 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-28179e40-4129-4301-b14d-60ca17486e90 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:56.597402 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-28179e40-4129-4301-b14d-60ca17486e90 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:56.598192 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-28179e40-4129-4301-b14d-60ca17486e90 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:56.598652 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-28179e40-4129-4301-b14d-60ca17486e90 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:56.753476 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-28179e40-4129-4301-b14d-60ca17486e90 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:59:56.762771 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-28179e40-4129-4301-b14d-60ca17486e90 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a" status: 200 len: 1740 microversion: 2.1 time: 0.180246 Aug 02 10:59:56.763395 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 280/564] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:59:56 2022] GET /compute/v2.1/servers/8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a => generated 1740 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:59:57.159553 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-61f6e996-a493-4f13-8f44-2f36e7da336b tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:59:57.159553 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-61f6e996-a493-4f13-8f44-2f36e7da336b tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] [instance: 93775f02-e62c-4392-a1ed-cfd5dd956dd7] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:59:57.164898 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-61f6e996-a493-4f13-8f44-2f36e7da336b tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:57.165482 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-61f6e996-a493-4f13-8f44-2f36e7da336b tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:57.166566 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-61f6e996-a493-4f13-8f44-2f36e7da336b tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:57.167021 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-61f6e996-a493-4f13-8f44-2f36e7da336b tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:57.178114 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-6a70131c-ef7e-488f-b877-ebaa703614d3 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6ac5f41e-f16e-4d5d-bb7c-4b0ead23e673"}} {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:59:57.180663 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-6a70131c-ef7e-488f-b877-ebaa703614d3 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: a780ca09-3975-44eb-9464-355460c10686] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:59:57.188595 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-6a70131c-ef7e-488f-b877-ebaa703614d3 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:57.193846 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-6a70131c-ef7e-488f-b877-ebaa703614d3 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:57.193846 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-6a70131c-ef7e-488f-b877-ebaa703614d3 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:57.193846 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-6a70131c-ef7e-488f-b877-ebaa703614d3 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:57.244884 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-61f6e996-a493-4f13-8f44-2f36e7da336b tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f41f17f5154e01a699043edc350cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e92110a1545f1b84644b8971bb6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:59:57.252865 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-61f6e996-a493-4f13-8f44-2f36e7da336b tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] 10.222.0.115 "GET /compute/v2.1/servers/93775f02-e62c-4392-a1ed-cfd5dd956dd7" status: 200 len: 1292 microversion: 2.1 time: 0.099794 Aug 02 10:59:57.253768 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 285/565] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:59:57 2022] GET /compute/v2.1/servers/93775f02-e62c-4392-a1ed-cfd5dd956dd7 => generated 1292 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:59:57.284765 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.wsgi [None req-6a70131c-ef7e-488f-b877-ebaa703614d3 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] HTTP exception thrown: Invalid volume: volume 6ac5f41e-f16e-4d5d-bb7c-4b0ead23e673 is already attached to instances: a780ca09-3975-44eb-9464-355460c10686 Aug 02 10:59:57.286536 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-6a70131c-ef7e-488f-b877-ebaa703614d3 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Request method failure captured: Aug 02 10:59:57.286536 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: request: POST /compute/v2.1/servers/a780ca09-3975-44eb-9464-355460c10686/os-volume_attachments HTTP/1.1 Aug 02 10:59:57.286536 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Accept: application/json Aug 02 10:59:57.286536 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Accept-Encoding: identity Aug 02 10:59:57.286536 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Connection: close Aug 02 10:59:57.286536 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Content-Length: 74 Aug 02 10:59:57.286536 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Content-Type: application/json Aug 02 10:59:57.286536 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Host: 10.222.0.115 Aug 02 10:59:57.286536 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Openstack-System-Scope: None Aug 02 10:59:57.286536 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: User-Agent: python-urllib3/1.26.10 Aug 02 10:59:57.286536 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Auth-Token: gAAAAABi6QKMm0zWjcrgGxsKGjmUpSACSDsl300OSZbmfbKI8W7YRiqQlsT7G2Yz8bTCtqeY5P5LouAzxFYTu1e6mP7SLmcSkT2w0SAqH9Ev0MtEiqJ7hFJOgCTtlSAmMKZk3KczE4deWY0afZWtzWq9Z6D1UUJ57x6ix6Lv8M0Q8lVdVaQlJYs Aug 02 10:59:57.286536 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Domain-Id: None Aug 02 10:59:57.286536 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Domain-Name: None Aug 02 10:59:57.286536 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Identity-Status: Confirmed Aug 02 10:59:57.286536 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Is-Admin-Project: True Aug 02 10:59:57.286536 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Project-Domain-Id: default Aug 02 10:59:57.286536 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Project-Domain-Name: Default Aug 02 10:59:57.286536 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Project-Id: 89a4a0cf1852449e8bfc59ddb5a902c1 Aug 02 10:59:57.286536 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Project-Name: tempest-AttachVolumeNegativeTest-1965368294 Aug 02 10:59:57.286536 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Role: reader,member Aug 02 10:59:57.286536 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Roles: reader,member Aug 02 10:59:57.288277 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/89a4a0cf1852449e8bfc59ddb5a902c1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2/89a4a0cf1852449e8bfc59ddb5a902c1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/89a4a0cf1852449e8bfc59ddb5a902c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.115:8080", "publicURL": "http://10.222.0.115:8080/v1/AUTH_89a4a0cf1852449e8bfc59ddb5a902c1"}]}] Aug 02 10:59:57.288277 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Tenant: tempest-AttachVolumeNegativeTest-1965368294 Aug 02 10:59:57.288277 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Tenant-Id: 89a4a0cf1852449e8bfc59ddb5a902c1 Aug 02 10:59:57.288277 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1965368294 Aug 02 10:59:57.288277 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User: tempest-AttachVolumeNegativeTest-1965368294-project Aug 02 10:59:57.288277 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User-Domain-Id: default Aug 02 10:59:57.288277 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User-Domain-Name: Default Aug 02 10:59:57.288277 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User-Id: 53bc14ada1564911b2f0a698aef3f333 Aug 02 10:59:57.288277 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User-Name: tempest-AttachVolumeNegativeTest-1965368294-project Aug 02 10:59:57.288277 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Aug 02 10:59:57.288277 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: {"volumeAttachment": {"volumeId": "6ac5f41e-f16e-4d5d-bb7c-4b0ead23e673"}} Aug 02 10:59:57.288277 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: method: > Aug 02 10:59:57.289079 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: exception: Invalid volume: volume 6ac5f41e-f16e-4d5d-bb7c-4b0ead23e673 is already attached to instances: a780ca09-3975-44eb-9464-355460c10686 Aug 02 10:59:57.289079 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: action_args: {'server_id': 'a780ca09-3975-44eb-9464-355460c10686', 'body': {'volumeAttachment': {'volumeId': '6ac5f41e-f16e-4d5d-bb7c-4b0ead23e673'}}} Aug 02 10:59:57.289079 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 10:59:57.289079 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:59:57.289079 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 02 10:59:57.289079 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 02 10:59:57.289079 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 02 10:59:57.289079 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 02 10:59:57.289079 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 02 10:59:57.289079 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 02 10:59:57.289079 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 02 10:59:57.289079 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 02 10:59:57.289079 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 02 10:59:57.289079 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 02 10:59:57.289079 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 6ac5f41e-f16e-4d5d-bb7c-4b0ead23e673 is already attached to instances: a780ca09-3975-44eb-9464-355460c10686 Aug 02 10:59:57.289079 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 10:59:57.289079 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:59:57.289079 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 10:59:57.289079 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:59:57.290305 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:59:57.290305 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:59:57.290305 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 10:59:57.290305 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 10:59:57.290305 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 10:59:57.290305 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 10:59:57.290305 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 10:59:57.290305 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 10:59:57.290305 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 10:59:57.290305 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 10:59:57.290305 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 10:59:57.290305 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 10:59:57.290305 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 02 10:59:57.290305 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 02 10:59:57.290305 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 6ac5f41e-f16e-4d5d-bb7c-4b0ead23e673 is already attached to instances: a780ca09-3975-44eb-9464-355460c10686 Aug 02 10:59:57.290305 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 10:59:57.290305 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 10:59:57.290305 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 10:59:57.290305 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 10:59:57.290305 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 10:59:57.292839 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 10:59:57.292839 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 10:59:57.292839 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 10:59:57.292839 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 6ac5f41e-f16e-4d5d-bb7c-4b0ead23e673 is already attached to instances: a780ca09-3975-44eb-9464-355460c10686 Aug 02 10:59:57.292839 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 10:59:57.292839 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-6a70131c-ef7e-488f-b877-ebaa703614d3 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Returning 400 to user: Invalid volume: volume 6ac5f41e-f16e-4d5d-bb7c-4b0ead23e673 is already attached to instances: a780ca09-3975-44eb-9464-355460c10686 {{(pid=129952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 10:59:57.292839 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-6a70131c-ef7e-488f-b877-ebaa703614d3 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "POST /compute/v2.1/servers/a780ca09-3975-44eb-9464-355460c10686/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.114431 Aug 02 10:59:57.292839 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 281/566] 10.222.0.115 () {60 vars in 1328 bytes} [Tue Aug 2 10:59:57 2022] POST /compute/v2.1/servers/a780ca09-3975-44eb-9464-355460c10686/os-volume_attachments => generated 174 bytes in 116 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 02 10:59:57.357815 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-f8dc6477-33f3-47ae-b2e8-56f37a378e0c tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:59:57.364662 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-f8dc6477-33f3-47ae-b2e8-56f37a378e0c tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: a780ca09-3975-44eb-9464-355460c10686] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:59:57.364862 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-f8dc6477-33f3-47ae-b2e8-56f37a378e0c tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:57.365365 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-f8dc6477-33f3-47ae-b2e8-56f37a378e0c tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:57.366216 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-f8dc6477-33f3-47ae-b2e8-56f37a378e0c tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:57.366721 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-f8dc6477-33f3-47ae-b2e8-56f37a378e0c tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:57.511798 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.objects.instance [None req-f8dc6477-33f3-47ae-b2e8-56f37a378e0c tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lazy-loading 'services' on Instance uuid a780ca09-3975-44eb-9464-355460c10686 {{(pid=129953) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 10:59:57.777468 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-f8dc6477-33f3-47ae-b2e8-56f37a378e0c tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "DELETE /compute/v2.1/servers/a780ca09-3975-44eb-9464-355460c10686/os-volume_attachments/6ac5f41e-f16e-4d5d-bb7c-4b0ead23e673" status: 202 len: 0 microversion: 2.1 time: 0.423776 Aug 02 10:59:57.781770 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 286/567] 10.222.0.115 () {58 vars in 1421 bytes} [Tue Aug 2 10:59:57 2022] DELETE /compute/v2.1/servers/a780ca09-3975-44eb-9464-355460c10686/os-volume_attachments/6ac5f41e-f16e-4d5d-bb7c-4b0ead23e673 => generated 0 bytes in 425 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 10:59:57.785987 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-a141807a-02ab-454b-aacc-bbb436ddb12d tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:59:57.786604 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-a141807a-02ab-454b-aacc-bbb436ddb12d tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:59:57.787243 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-5fbe0727-e4dd-463b-897c-bb8198e2b63c tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:59:57.789634 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-5fbe0727-e4dd-463b-897c-bb8198e2b63c tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: a780ca09-3975-44eb-9464-355460c10686] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:59:57.794564 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-a141807a-02ab-454b-aacc-bbb436ddb12d tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:57.795231 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-a141807a-02ab-454b-aacc-bbb436ddb12d tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:57.796045 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-a141807a-02ab-454b-aacc-bbb436ddb12d tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:57.796364 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-5fbe0727-e4dd-463b-897c-bb8198e2b63c tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:57.796562 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-a141807a-02ab-454b-aacc-bbb436ddb12d tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:57.796749 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-5fbe0727-e4dd-463b-897c-bb8198e2b63c tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:57.797513 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-5fbe0727-e4dd-463b-897c-bb8198e2b63c tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:57.797946 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-5fbe0727-e4dd-463b-897c-bb8198e2b63c tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:57.817623 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG dbcounter [-] [129953] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=129953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:59:57.833231 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-5fbe0727-e4dd-463b-897c-bb8198e2b63c tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "GET /compute/v2.1/servers/a780ca09-3975-44eb-9464-355460c10686/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050077 Aug 02 10:59:57.833812 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 287/568] 10.222.0.115 () {58 vars in 1307 bytes} [Tue Aug 2 10:59:57 2022] GET /compute/v2.1/servers/a780ca09-3975-44eb-9464-355460c10686/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:59:58.028428 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-a141807a-02ab-454b-aacc-bbb436ddb12d tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:59:58.037178 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-a141807a-02ab-454b-aacc-bbb436ddb12d tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a" status: 200 len: 1740 microversion: 2.1 time: 0.256023 Aug 02 10:59:58.051427 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 282/569] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:59:57 2022] GET /compute/v2.1/servers/8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a => generated 1740 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:59:58.277666 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-258a44cd-f2d2-4467-ab3d-f44ec15ac8d7 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:59:58.278279 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-258a44cd-f2d2-4467-ab3d-f44ec15ac8d7 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] [instance: 93775f02-e62c-4392-a1ed-cfd5dd956dd7] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:59:58.286437 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-258a44cd-f2d2-4467-ab3d-f44ec15ac8d7 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:58.290975 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-258a44cd-f2d2-4467-ab3d-f44ec15ac8d7 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:58.290975 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-258a44cd-f2d2-4467-ab3d-f44ec15ac8d7 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:58.290975 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-258a44cd-f2d2-4467-ab3d-f44ec15ac8d7 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:58.506685 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-258a44cd-f2d2-4467-ab3d-f44ec15ac8d7 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f41f17f5154e01a699043edc350cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e92110a1545f1b84644b8971bb6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:59:58.514719 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-258a44cd-f2d2-4467-ab3d-f44ec15ac8d7 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] 10.222.0.115 "GET /compute/v2.1/servers/93775f02-e62c-4392-a1ed-cfd5dd956dd7" status: 200 len: 1365 microversion: 2.1 time: 0.241148 Aug 02 10:59:58.516196 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 288/570] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:59:58 2022] GET /compute/v2.1/servers/93775f02-e62c-4392-a1ed-cfd5dd956dd7 => generated 1365 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:59:58.847169 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-35419603-c76e-439f-ac52-c5f505ae5c21 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:59:58.849418 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-35419603-c76e-439f-ac52-c5f505ae5c21 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: a780ca09-3975-44eb-9464-355460c10686] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:59:58.857262 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-35419603-c76e-439f-ac52-c5f505ae5c21 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:58.857716 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-35419603-c76e-439f-ac52-c5f505ae5c21 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:58.858474 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-35419603-c76e-439f-ac52-c5f505ae5c21 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:58.858949 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-35419603-c76e-439f-ac52-c5f505ae5c21 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:58.894424 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-35419603-c76e-439f-ac52-c5f505ae5c21 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "GET /compute/v2.1/servers/a780ca09-3975-44eb-9464-355460c10686/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051104 Aug 02 10:59:58.895060 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 283/571] 10.222.0.115 () {58 vars in 1307 bytes} [Tue Aug 2 10:59:58 2022] GET /compute/v2.1/servers/a780ca09-3975-44eb-9464-355460c10686/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 10:59:59.059948 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-0f903aca-18d3-4eba-ad32-03973aebe019 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:59:59.060559 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-0f903aca-18d3-4eba-ad32-03973aebe019 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:59:59.066732 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-0f903aca-18d3-4eba-ad32-03973aebe019 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:59.067211 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-0f903aca-18d3-4eba-ad32-03973aebe019 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:59.067968 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-0f903aca-18d3-4eba-ad32-03973aebe019 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:59.068398 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-0f903aca-18d3-4eba-ad32-03973aebe019 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:59.164778 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [req-6c422084-0c3d-4963-909a-d87b6b3dfb62 req-88a7a764-a1a5-4b9c-8a6f-5c62ca92ad83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93775f02-e62c-4392-a1ed-cfd5dd956dd7", "tag": "571a2e00-abb0-4402-8c1a-59fe26898cf1"}]} {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 10:59:59.175203 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [req-6c422084-0c3d-4963-909a-d87b6b3dfb62 req-88a7a764-a1a5-4b9c-8a6f-5c62ca92ad83 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:59.175913 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [req-6c422084-0c3d-4963-909a-d87b6b3dfb62 req-88a7a764-a1a5-4b9c-8a6f-5c62ca92ad83 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:59.189209 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.compute.server_external_events [req-6c422084-0c3d-4963-909a-d87b6b3dfb62 req-88a7a764-a1a5-4b9c-8a6f-5c62ca92ad83 service nova] Creating event network-changed:571a2e00-abb0-4402-8c1a-59fe26898cf1 for instance 93775f02-e62c-4392-a1ed-cfd5dd956dd7 on hv-cinder-85031 Aug 02 10:59:59.194337 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [req-6c422084-0c3d-4963-909a-d87b6b3dfb62 req-88a7a764-a1a5-4b9c-8a6f-5c62ca92ad83 service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033044 Aug 02 10:59:59.198190 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 284/572] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Aug 2 10:59:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 10:59:59.211400 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-0f903aca-18d3-4eba-ad32-03973aebe019 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:59:59.224407 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-0f903aca-18d3-4eba-ad32-03973aebe019 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a" status: 200 len: 1740 microversion: 2.1 time: 0.168443 Aug 02 10:59:59.224570 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 289/573] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:59:59 2022] GET /compute/v2.1/servers/8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a => generated 1740 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:59:59.538344 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-fd40b5dd-c50c-4a32-b350-9a36510f41d9 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:59:59.539088 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-fd40b5dd-c50c-4a32-b350-9a36510f41d9 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] [instance: 93775f02-e62c-4392-a1ed-cfd5dd956dd7] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:59:59.546180 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-fd40b5dd-c50c-4a32-b350-9a36510f41d9 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:59.546657 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-fd40b5dd-c50c-4a32-b350-9a36510f41d9 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:59.548541 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-fd40b5dd-c50c-4a32-b350-9a36510f41d9 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:59.549324 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-fd40b5dd-c50c-4a32-b350-9a36510f41d9 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:59.693021 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-fd40b5dd-c50c-4a32-b350-9a36510f41d9 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f41f17f5154e01a699043edc350cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e92110a1545f1b84644b8971bb6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 10:59:59.701099 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-fd40b5dd-c50c-4a32-b350-9a36510f41d9 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] 10.222.0.115 "GET /compute/v2.1/servers/93775f02-e62c-4392-a1ed-cfd5dd956dd7" status: 200 len: 1365 microversion: 2.1 time: 0.167079 Aug 02 10:59:59.701883 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 285/574] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 10:59:59 2022] GET /compute/v2.1/servers/93775f02-e62c-4392-a1ed-cfd5dd956dd7 => generated 1365 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 10:59:59.909889 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-2df63e94-945b-4566-ac5b-11c38a477168 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 10:59:59.912489 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-2df63e94-945b-4566-ac5b-11c38a477168 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: a780ca09-3975-44eb-9464-355460c10686] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 10:59:59.919640 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-2df63e94-945b-4566-ac5b-11c38a477168 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:59.920089 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-2df63e94-945b-4566-ac5b-11c38a477168 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:59.921185 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-2df63e94-945b-4566-ac5b-11c38a477168 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 10:59:59.921620 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-2df63e94-945b-4566-ac5b-11c38a477168 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 10:59:59.951004 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-2df63e94-945b-4566-ac5b-11c38a477168 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "GET /compute/v2.1/servers/a780ca09-3975-44eb-9464-355460c10686/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045039 Aug 02 10:59:59.951681 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 290/575] 10.222.0.115 () {58 vars in 1307 bytes} [Tue Aug 2 10:59:59 2022] GET /compute/v2.1/servers/a780ca09-3975-44eb-9464-355460c10686/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 11:00:00.016180 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-3ee59b94-ce28-405a-9141-e242b1c09671 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:00.016885 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-3ee59b94-ce28-405a-9141-e242b1c09671 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: a780ca09-3975-44eb-9464-355460c10686] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:00.023622 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-3ee59b94-ce28-405a-9141-e242b1c09671 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:00.024068 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-3ee59b94-ce28-405a-9141-e242b1c09671 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:00.025551 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-3ee59b94-ce28-405a-9141-e242b1c09671 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:00.025988 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-3ee59b94-ce28-405a-9141-e242b1c09671 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:00.052265 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-3ee59b94-ce28-405a-9141-e242b1c09671 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: a780ca09-3975-44eb-9464-355460c10686] Going to try to terminate instance {{(pid=129952) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 11:00:00.079732 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG dbcounter [-] [129952] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 11:00:00.246918 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-0b6f3e60-cf5e-40c9-ae86-1b531d7a8a15 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:00.247552 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-0b6f3e60-cf5e-40c9-ae86-1b531d7a8a15 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:00.253595 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-0b6f3e60-cf5e-40c9-ae86-1b531d7a8a15 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:00.254036 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-0b6f3e60-cf5e-40c9-ae86-1b531d7a8a15 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:00.254794 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-0b6f3e60-cf5e-40c9-ae86-1b531d7a8a15 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:00.255282 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-0b6f3e60-cf5e-40c9-ae86-1b531d7a8a15 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:00.394499 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-0b6f3e60-cf5e-40c9-ae86-1b531d7a8a15 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:00.402684 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-0b6f3e60-cf5e-40c9-ae86-1b531d7a8a15 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a" status: 200 len: 1740 microversion: 2.1 time: 0.160656 Aug 02 11:00:00.403279 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 291/576] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:00:00 2022] GET /compute/v2.1/servers/8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a => generated 1740 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 11:00:00.422562 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-3ee59b94-ce28-405a-9141-e242b1c09671 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "DELETE /compute/v2.1/servers/a780ca09-3975-44eb-9464-355460c10686" status: 204 len: 0 microversion: 2.1 time: 0.409981 Aug 02 11:00:00.426377 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 286/577] 10.222.0.115 () {58 vars in 1244 bytes} [Tue Aug 2 11:00:00 2022] DELETE /compute/v2.1/servers/a780ca09-3975-44eb-9464-355460c10686 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 02 11:00:00.433696 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-4199b97f-6d68-4a83-a235-71bf04c86277 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:00.434314 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-4199b97f-6d68-4a83-a235-71bf04c86277 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: a780ca09-3975-44eb-9464-355460c10686] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:00.440523 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-4199b97f-6d68-4a83-a235-71bf04c86277 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:00.440975 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-4199b97f-6d68-4a83-a235-71bf04c86277 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:00.441742 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-4199b97f-6d68-4a83-a235-71bf04c86277 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:00.442177 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-4199b97f-6d68-4a83-a235-71bf04c86277 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:00.578921 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-4199b97f-6d68-4a83-a235-71bf04c86277 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bc14ada1564911b2f0a698aef3f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a4a0cf1852449e8bfc59ddb5a902c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:00.586423 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-4199b97f-6d68-4a83-a235-71bf04c86277 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "GET /compute/v2.1/servers/a780ca09-3975-44eb-9464-355460c10686" status: 200 len: 1683 microversion: 2.1 time: 0.157161 Aug 02 11:00:00.587030 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 292/578] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:00:00 2022] GET /compute/v2.1/servers/a780ca09-3975-44eb-9464-355460c10686 => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 11:00:00.723313 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-0992105d-2c41-403c-8643-b83802dab338 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:00.723925 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-0992105d-2c41-403c-8643-b83802dab338 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] [instance: 93775f02-e62c-4392-a1ed-cfd5dd956dd7] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:00.730915 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-0992105d-2c41-403c-8643-b83802dab338 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:00.731398 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-0992105d-2c41-403c-8643-b83802dab338 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:00.732164 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-0992105d-2c41-403c-8643-b83802dab338 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:00.732601 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-0992105d-2c41-403c-8643-b83802dab338 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:00.864064 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-0992105d-2c41-403c-8643-b83802dab338 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f41f17f5154e01a699043edc350cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e92110a1545f1b84644b8971bb6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:00.871742 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-0992105d-2c41-403c-8643-b83802dab338 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] 10.222.0.115 "GET /compute/v2.1/servers/93775f02-e62c-4392-a1ed-cfd5dd956dd7" status: 200 len: 1365 microversion: 2.1 time: 0.152850 Aug 02 11:00:00.872306 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 287/579] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:00:00 2022] GET /compute/v2.1/servers/93775f02-e62c-4392-a1ed-cfd5dd956dd7 => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:00:01.424293 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-2bb51346-3c2d-4303-8710-a613f5d2ad51 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:01.424905 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-2bb51346-3c2d-4303-8710-a613f5d2ad51 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:01.431834 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-2bb51346-3c2d-4303-8710-a613f5d2ad51 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:01.432282 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-2bb51346-3c2d-4303-8710-a613f5d2ad51 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:01.433057 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-2bb51346-3c2d-4303-8710-a613f5d2ad51 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:01.433510 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-2bb51346-3c2d-4303-8710-a613f5d2ad51 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:01.567769 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-2bb51346-3c2d-4303-8710-a613f5d2ad51 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:01.577067 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-2bb51346-3c2d-4303-8710-a613f5d2ad51 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a" status: 200 len: 1740 microversion: 2.1 time: 0.156690 Aug 02 11:00:01.577642 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 293/580] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:00:01 2022] GET /compute/v2.1/servers/8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a => generated 1740 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 11:00:01.608050 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-8375b029-6e45-4a13-9e13-7fa5e56acc35 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:01.608666 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-8375b029-6e45-4a13-9e13-7fa5e56acc35 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: a780ca09-3975-44eb-9464-355460c10686] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:01.615252 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-8375b029-6e45-4a13-9e13-7fa5e56acc35 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:01.615697 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-8375b029-6e45-4a13-9e13-7fa5e56acc35 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:01.616451 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-8375b029-6e45-4a13-9e13-7fa5e56acc35 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:01.616879 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-8375b029-6e45-4a13-9e13-7fa5e56acc35 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:01.747330 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-8375b029-6e45-4a13-9e13-7fa5e56acc35 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bc14ada1564911b2f0a698aef3f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a4a0cf1852449e8bfc59ddb5a902c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:01.755248 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-8375b029-6e45-4a13-9e13-7fa5e56acc35 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "GET /compute/v2.1/servers/a780ca09-3975-44eb-9464-355460c10686" status: 200 len: 1683 microversion: 2.1 time: 0.150948 Aug 02 11:00:01.755804 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 288/581] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:00:01 2022] GET /compute/v2.1/servers/a780ca09-3975-44eb-9464-355460c10686 => generated 1683 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:00:01.892810 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-c8e35459-124c-42f2-9bf9-aac602609332 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:01.893416 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-c8e35459-124c-42f2-9bf9-aac602609332 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] [instance: 93775f02-e62c-4392-a1ed-cfd5dd956dd7] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:01.899705 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-c8e35459-124c-42f2-9bf9-aac602609332 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:01.900278 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-c8e35459-124c-42f2-9bf9-aac602609332 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:01.901079 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-c8e35459-124c-42f2-9bf9-aac602609332 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:01.901518 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-c8e35459-124c-42f2-9bf9-aac602609332 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:02.036493 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-c8e35459-124c-42f2-9bf9-aac602609332 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f41f17f5154e01a699043edc350cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e92110a1545f1b84644b8971bb6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:02.045192 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-c8e35459-124c-42f2-9bf9-aac602609332 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] 10.222.0.115 "GET /compute/v2.1/servers/93775f02-e62c-4392-a1ed-cfd5dd956dd7" status: 200 len: 1365 microversion: 2.1 time: 0.156255 Aug 02 11:00:02.045783 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 294/582] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:00:01 2022] GET /compute/v2.1/servers/93775f02-e62c-4392-a1ed-cfd5dd956dd7 => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:00:02.599577 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-a9531aa3-746d-4576-943d-b796a98da619 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:02.600195 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-a9531aa3-746d-4576-943d-b796a98da619 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:02.607356 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-a9531aa3-746d-4576-943d-b796a98da619 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:02.607963 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-a9531aa3-746d-4576-943d-b796a98da619 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:02.608916 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-a9531aa3-746d-4576-943d-b796a98da619 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:02.609821 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-a9531aa3-746d-4576-943d-b796a98da619 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:02.748851 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-a9531aa3-746d-4576-943d-b796a98da619 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:02.758132 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-a9531aa3-746d-4576-943d-b796a98da619 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a" status: 200 len: 1740 microversion: 2.1 time: 0.162554 Aug 02 11:00:02.759099 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 289/583] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:00:02 2022] GET /compute/v2.1/servers/8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a => generated 1740 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:00:02.777554 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-44bfbb1a-6155-42dc-8a3c-9e52f4d83831 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:02.778217 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-44bfbb1a-6155-42dc-8a3c-9e52f4d83831 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: a780ca09-3975-44eb-9464-355460c10686] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:02.788452 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-44bfbb1a-6155-42dc-8a3c-9e52f4d83831 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:02.789155 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-44bfbb1a-6155-42dc-8a3c-9e52f4d83831 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:02.790996 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-44bfbb1a-6155-42dc-8a3c-9e52f4d83831 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:02.791721 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-44bfbb1a-6155-42dc-8a3c-9e52f4d83831 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:02.938180 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-44bfbb1a-6155-42dc-8a3c-9e52f4d83831 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bc14ada1564911b2f0a698aef3f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a4a0cf1852449e8bfc59ddb5a902c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:02.945806 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-44bfbb1a-6155-42dc-8a3c-9e52f4d83831 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "GET /compute/v2.1/servers/a780ca09-3975-44eb-9464-355460c10686" status: 200 len: 1683 microversion: 2.1 time: 0.172379 Aug 02 11:00:02.946395 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 295/584] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:00:02 2022] GET /compute/v2.1/servers/a780ca09-3975-44eb-9464-355460c10686 => generated 1683 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:00:03.067815 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-4b0535e3-0a70-4e6e-9d44-ea485f5b9ed1 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:03.068466 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-4b0535e3-0a70-4e6e-9d44-ea485f5b9ed1 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] [instance: 93775f02-e62c-4392-a1ed-cfd5dd956dd7] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:03.074580 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-4b0535e3-0a70-4e6e-9d44-ea485f5b9ed1 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:03.075034 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-4b0535e3-0a70-4e6e-9d44-ea485f5b9ed1 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:03.075832 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-4b0535e3-0a70-4e6e-9d44-ea485f5b9ed1 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:03.076275 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-4b0535e3-0a70-4e6e-9d44-ea485f5b9ed1 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:03.207878 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-4b0535e3-0a70-4e6e-9d44-ea485f5b9ed1 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f41f17f5154e01a699043edc350cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e92110a1545f1b84644b8971bb6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:03.216433 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-4b0535e3-0a70-4e6e-9d44-ea485f5b9ed1 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] 10.222.0.115 "GET /compute/v2.1/servers/93775f02-e62c-4392-a1ed-cfd5dd956dd7" status: 200 len: 1365 microversion: 2.1 time: 0.153871 Aug 02 11:00:03.217010 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 290/585] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:00:03 2022] GET /compute/v2.1/servers/93775f02-e62c-4392-a1ed-cfd5dd956dd7 => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:00:03.782632 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-9f3e4ac8-dcb4-4d0c-8e4f-f3e5235598b5 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:03.785078 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-9f3e4ac8-dcb4-4d0c-8e4f-f3e5235598b5 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:03.792897 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-9f3e4ac8-dcb4-4d0c-8e4f-f3e5235598b5 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:03.793358 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-9f3e4ac8-dcb4-4d0c-8e4f-f3e5235598b5 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:03.794336 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-9f3e4ac8-dcb4-4d0c-8e4f-f3e5235598b5 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:03.794769 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-9f3e4ac8-dcb4-4d0c-8e4f-f3e5235598b5 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:03.957962 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-9f3e4ac8-dcb4-4d0c-8e4f-f3e5235598b5 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:03.967716 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-0c941581-80d6-47ce-8dd2-93713c36cd8b tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:03.969462 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-0c941581-80d6-47ce-8dd2-93713c36cd8b tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: a780ca09-3975-44eb-9464-355460c10686] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:03.969580 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-9f3e4ac8-dcb4-4d0c-8e4f-f3e5235598b5 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a" status: 200 len: 1740 microversion: 2.1 time: 0.191389 Aug 02 11:00:03.970647 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 296/586] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:00:03 2022] GET /compute/v2.1/servers/8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a => generated 1740 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:00:03.995782 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-0c941581-80d6-47ce-8dd2-93713c36cd8b tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:03.997694 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-0c941581-80d6-47ce-8dd2-93713c36cd8b tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:03.999884 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-0c941581-80d6-47ce-8dd2-93713c36cd8b tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:04.000706 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-0c941581-80d6-47ce-8dd2-93713c36cd8b tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:04.069657 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [req-04ccc5c1-2df4-41f1-8340-0aa684892005 req-0e656ac6-5921-4187-b63c-e6392b044049 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a780ca09-3975-44eb-9464-355460c10686", "name": "network-vif-deleted", "tag": "3632c3f9-a9a8-4c3d-8f53-e11c70651bbf"}]} {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 11:00:04.081739 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [req-04ccc5c1-2df4-41f1-8340-0aa684892005 req-0e656ac6-5921-4187-b63c-e6392b044049 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:04.082368 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [req-04ccc5c1-2df4-41f1-8340-0aa684892005 req-0e656ac6-5921-4187-b63c-e6392b044049 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:04.096257 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.compute.server_external_events [req-04ccc5c1-2df4-41f1-8340-0aa684892005 req-0e656ac6-5921-4187-b63c-e6392b044049 service nova] Creating event network-vif-deleted:3632c3f9-a9a8-4c3d-8f53-e11c70651bbf for instance a780ca09-3975-44eb-9464-355460c10686 on hv-cinder-85031 Aug 02 11:00:04.097451 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-0c941581-80d6-47ce-8dd2-93713c36cd8b tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bc14ada1564911b2f0a698aef3f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a4a0cf1852449e8bfc59ddb5a902c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:04.102721 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [req-04ccc5c1-2df4-41f1-8340-0aa684892005 req-0e656ac6-5921-4187-b63c-e6392b044049 service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035667 Aug 02 11:00:04.102721 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 297/587] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Aug 2 11:00:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 11:00:04.108227 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-0c941581-80d6-47ce-8dd2-93713c36cd8b tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "GET /compute/v2.1/servers/a780ca09-3975-44eb-9464-355460c10686" status: 200 len: 1616 microversion: 2.1 time: 0.144778 Aug 02 11:00:04.108876 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 291/588] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:00:03 2022] GET /compute/v2.1/servers/a780ca09-3975-44eb-9464-355460c10686 => generated 1616 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 11:00:04.240794 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-32c70b63-b884-438b-9923-1125f1322eb4 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:04.242903 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-32c70b63-b884-438b-9923-1125f1322eb4 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] [instance: 93775f02-e62c-4392-a1ed-cfd5dd956dd7] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:04.265540 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-32c70b63-b884-438b-9923-1125f1322eb4 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:04.265998 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-32c70b63-b884-438b-9923-1125f1322eb4 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:04.266785 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-32c70b63-b884-438b-9923-1125f1322eb4 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:04.267606 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-32c70b63-b884-438b-9923-1125f1322eb4 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:04.428312 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-32c70b63-b884-438b-9923-1125f1322eb4 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f41f17f5154e01a699043edc350cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e92110a1545f1b84644b8971bb6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:04.437765 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-32c70b63-b884-438b-9923-1125f1322eb4 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] 10.222.0.115 "GET /compute/v2.1/servers/93775f02-e62c-4392-a1ed-cfd5dd956dd7" status: 200 len: 1365 microversion: 2.1 time: 0.203220 Aug 02 11:00:04.438351 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 298/589] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:00:04 2022] GET /compute/v2.1/servers/93775f02-e62c-4392-a1ed-cfd5dd956dd7 => generated 1365 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:00:04.993077 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-6b89c90c-6d32-4e2a-80d3-dacfece6c8a1 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:04.994093 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-6b89c90c-6d32-4e2a-80d3-dacfece6c8a1 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:04.996147 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG dbcounter [-] [129952] Writing DB stats nova_cell0:SELECT=2 {{(pid=129952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 11:00:04.996916 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG dbcounter [-] [129952] Writing DB stats nova_cell0:SELECT=10 {{(pid=129952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 11:00:05.002609 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-6b89c90c-6d32-4e2a-80d3-dacfece6c8a1 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:05.003120 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-6b89c90c-6d32-4e2a-80d3-dacfece6c8a1 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:05.003903 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-6b89c90c-6d32-4e2a-80d3-dacfece6c8a1 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:05.004354 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-6b89c90c-6d32-4e2a-80d3-dacfece6c8a1 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:05.130189 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-07cdb96b-dde0-46ea-b127-b82f63d255f2 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:05.130937 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-07cdb96b-dde0-46ea-b127-b82f63d255f2 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: a780ca09-3975-44eb-9464-355460c10686] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:05.144169 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG dbcounter [-] [129953] Writing DB stats nova_cell0:SELECT=2 {{(pid=129953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 11:00:05.144169 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-07cdb96b-dde0-46ea-b127-b82f63d255f2 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:05.144169 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-07cdb96b-dde0-46ea-b127-b82f63d255f2 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:05.144169 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-07cdb96b-dde0-46ea-b127-b82f63d255f2 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:05.145065 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-07cdb96b-dde0-46ea-b127-b82f63d255f2 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:05.150596 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-6b89c90c-6d32-4e2a-80d3-dacfece6c8a1 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:05.159904 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-6b89c90c-6d32-4e2a-80d3-dacfece6c8a1 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a" status: 200 len: 1740 microversion: 2.1 time: 0.170934 Aug 02 11:00:05.160919 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 292/590] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:00:04 2022] GET /compute/v2.1/servers/8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a => generated 1740 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:00:05.161542 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.wsgi [None req-07cdb96b-dde0-46ea-b127-b82f63d255f2 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] HTTP exception thrown: Instance a780ca09-3975-44eb-9464-355460c10686 could not be found. Aug 02 11:00:05.163292 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-07cdb96b-dde0-46ea-b127-b82f63d255f2 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Request method failure captured: Aug 02 11:00:05.163292 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: request: GET /compute/v2.1/servers/a780ca09-3975-44eb-9464-355460c10686 HTTP/1.1 Aug 02 11:00:05.163292 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Accept: application/json Aug 02 11:00:05.163292 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Accept-Encoding: identity Aug 02 11:00:05.163292 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Connection: close Aug 02 11:00:05.163292 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Content-Length: 0 Aug 02 11:00:05.163292 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Content-Type: application/json Aug 02 11:00:05.163292 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Host: 10.222.0.115 Aug 02 11:00:05.163292 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Openstack-System-Scope: None Aug 02 11:00:05.163292 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: User-Agent: python-urllib3/1.26.10 Aug 02 11:00:05.163292 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Auth-Token: gAAAAABi6QKMm0zWjcrgGxsKGjmUpSACSDsl300OSZbmfbKI8W7YRiqQlsT7G2Yz8bTCtqeY5P5LouAzxFYTu1e6mP7SLmcSkT2w0SAqH9Ev0MtEiqJ7hFJOgCTtlSAmMKZk3KczE4deWY0afZWtzWq9Z6D1UUJ57x6ix6Lv8M0Q8lVdVaQlJYs Aug 02 11:00:05.163292 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Domain-Id: None Aug 02 11:00:05.163292 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Domain-Name: None Aug 02 11:00:05.163292 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Identity-Status: Confirmed Aug 02 11:00:05.163292 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Is-Admin-Project: True Aug 02 11:00:05.163292 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Project-Domain-Id: default Aug 02 11:00:05.163292 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Project-Domain-Name: Default Aug 02 11:00:05.163292 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Project-Id: 89a4a0cf1852449e8bfc59ddb5a902c1 Aug 02 11:00:05.163292 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Project-Name: tempest-AttachVolumeNegativeTest-1965368294 Aug 02 11:00:05.163292 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Role: reader,member Aug 02 11:00:05.163292 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Roles: reader,member Aug 02 11:00:05.164655 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/89a4a0cf1852449e8bfc59ddb5a902c1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2/89a4a0cf1852449e8bfc59ddb5a902c1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/89a4a0cf1852449e8bfc59ddb5a902c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.115:8080", "publicURL": "http://10.222.0.115:8080/v1/AUTH_89a4a0cf1852449e8bfc59ddb5a902c1"}]}] Aug 02 11:00:05.164655 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Tenant: tempest-AttachVolumeNegativeTest-1965368294 Aug 02 11:00:05.164655 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Tenant-Id: 89a4a0cf1852449e8bfc59ddb5a902c1 Aug 02 11:00:05.164655 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1965368294 Aug 02 11:00:05.164655 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User: tempest-AttachVolumeNegativeTest-1965368294-project Aug 02 11:00:05.164655 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User-Domain-Id: default Aug 02 11:00:05.164655 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User-Domain-Name: Default Aug 02 11:00:05.164655 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User-Id: 53bc14ada1564911b2f0a698aef3f333 Aug 02 11:00:05.164655 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User-Name: tempest-AttachVolumeNegativeTest-1965368294-project Aug 02 11:00:05.164655 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: method: > Aug 02 11:00:05.164655 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: exception: Instance a780ca09-3975-44eb-9464-355460c10686 could not be found. Aug 02 11:00:05.164655 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: action_args: {'id': 'a780ca09-3975-44eb-9464-355460c10686'} Aug 02 11:00:05.165479 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 11:00:05.165479 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:00:05.165479 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 11:00:05.165479 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 11:00:05.165479 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 11:00:05.165479 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 11:00:05.165479 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 11:00:05.165479 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 11:00:05.165479 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 11:00:05.165479 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 11:00:05.165479 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a780ca09-3975-44eb-9464-355460c10686 could not be found. Aug 02 11:00:05.165479 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 11:00:05.165479 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 11:00:05.165479 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 11:00:05.165479 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:00:05.165479 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 11:00:05.165479 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 11:00:05.165479 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 11:00:05.165479 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 11:00:05.165479 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 11:00:05.166738 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 11:00:05.166738 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 11:00:05.166738 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 11:00:05.166738 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 11:00:05.166738 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 11:00:05.166738 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 11:00:05.166738 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 11:00:05.166738 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a780ca09-3975-44eb-9464-355460c10686 could not be found. Aug 02 11:00:05.166738 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 11:00:05.166738 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 11:00:05.166738 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 11:00:05.166738 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:00:05.166738 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 11:00:05.166738 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 11:00:05.166738 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 11:00:05.166738 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 11:00:05.166738 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a780ca09-3975-44eb-9464-355460c10686 could not be found. Aug 02 11:00:05.166738 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 11:00:05.168190 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-07cdb96b-dde0-46ea-b127-b82f63d255f2 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Returning 404 to user: Instance a780ca09-3975-44eb-9464-355460c10686 could not be found. {{(pid=129953) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 11:00:05.168190 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-07cdb96b-dde0-46ea-b127-b82f63d255f2 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "GET /compute/v2.1/servers/a780ca09-3975-44eb-9464-355460c10686" status: 404 len: 111 microversion: 2.1 time: 0.038584 Aug 02 11:00:05.168190 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 299/591] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:00:05 2022] GET /compute/v2.1/servers/a780ca09-3975-44eb-9464-355460c10686 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 11:00:05.176248 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-a2ec3ffa-142f-42a0-9546-72de48876eaf tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Calling method '.version_select at 0x7f7c4ed740d0>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:05.263317 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-a2ec3ffa-142f-42a0-9546-72de48876eaf tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-210460134" status: 202 len: 0 microversion: 2.1 time: 0.091039 Aug 02 11:00:05.263925 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 293/592] 10.222.0.115 () {58 vars in 1223 bytes} [Tue Aug 2 11:00:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-210460134 => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 11:00:05.459367 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-4215a434-2d54-49d5-ac3e-8df725f3e4e9 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:05.459975 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-4215a434-2d54-49d5-ac3e-8df725f3e4e9 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] [instance: 93775f02-e62c-4392-a1ed-cfd5dd956dd7] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:05.466930 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-4215a434-2d54-49d5-ac3e-8df725f3e4e9 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:05.467408 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-4215a434-2d54-49d5-ac3e-8df725f3e4e9 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:05.468171 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-4215a434-2d54-49d5-ac3e-8df725f3e4e9 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:05.468627 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-4215a434-2d54-49d5-ac3e-8df725f3e4e9 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:05.624421 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-4215a434-2d54-49d5-ac3e-8df725f3e4e9 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f41f17f5154e01a699043edc350cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e92110a1545f1b84644b8971bb6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:05.632300 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-4215a434-2d54-49d5-ac3e-8df725f3e4e9 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] 10.222.0.115 "GET /compute/v2.1/servers/93775f02-e62c-4392-a1ed-cfd5dd956dd7" status: 200 len: 1365 microversion: 2.1 time: 0.176868 Aug 02 11:00:05.632908 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 300/593] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:00:05 2022] GET /compute/v2.1/servers/93775f02-e62c-4392-a1ed-cfd5dd956dd7 => generated 1365 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:00:05.975387 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [req-5692cfde-defe-46d1-8fb5-89df2eb19a5b req-89dc4ad3-32c4-4bfc-ace1-ae0d485a4959 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93775f02-e62c-4392-a1ed-cfd5dd956dd7", "name": "network-vif-plugged", "status": "completed", "tag": "571a2e00-abb0-4402-8c1a-59fe26898cf1"}]} {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 11:00:05.986355 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [req-5692cfde-defe-46d1-8fb5-89df2eb19a5b req-89dc4ad3-32c4-4bfc-ace1-ae0d485a4959 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:05.986692 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [req-5692cfde-defe-46d1-8fb5-89df2eb19a5b req-89dc4ad3-32c4-4bfc-ace1-ae0d485a4959 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:05.999960 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.compute.server_external_events [req-5692cfde-defe-46d1-8fb5-89df2eb19a5b req-89dc4ad3-32c4-4bfc-ace1-ae0d485a4959 service nova] Creating event network-vif-plugged:571a2e00-abb0-4402-8c1a-59fe26898cf1 for instance 93775f02-e62c-4392-a1ed-cfd5dd956dd7 on hv-cinder-85031 Aug 02 11:00:06.004969 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [req-5692cfde-defe-46d1-8fb5-89df2eb19a5b req-89dc4ad3-32c4-4bfc-ace1-ae0d485a4959 service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033473 Aug 02 11:00:06.005774 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 294/594] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Aug 2 11:00:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 11:00:06.106927 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-816491e2-987a-4b20-9e66-ef04edd7a0da tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Action: 'create', calling method: .version_select at 0x7f7c4e63de50>, body: {"keypair": {"name": "tempest-keypair-205189833", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEXBKHVMhNu0dYirfFQyTQJmH0CpE+95+kGA4KxoXCqYN4ayrcBUlkxBBIrGLeixU/LBTLahqWreuYBWnCZ/eYh9c2YV+VsqajxvyOMHxh7vkM9Daprvj+L0gLlC4SUT+w=="}} {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 11:00:06.122509 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.quota [None req-816491e2-987a-4b20-9e66-ef04edd7a0da tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Getting quotas for project 89a4a0cf1852449e8bfc59ddb5a902c1. Resources: {'key_pairs'} {{(pid=129953) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 11:00:06.126550 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.quota [None req-816491e2-987a-4b20-9e66-ef04edd7a0da tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Getting quotas for user 53bc14ada1564911b2f0a698aef3f333 and project 89a4a0cf1852449e8bfc59ddb5a902c1. Resources: {'key_pairs'} {{(pid=129953) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 11:00:06.186845 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-93b80ad0-1518-462b-92e0-0ca4ec287d4b tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:06.187496 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-93b80ad0-1518-462b-92e0-0ca4ec287d4b tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:06.194254 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-93b80ad0-1518-462b-92e0-0ca4ec287d4b tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:06.199523 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-93b80ad0-1518-462b-92e0-0ca4ec287d4b tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:06.199523 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-93b80ad0-1518-462b-92e0-0ca4ec287d4b tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:06.199523 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-93b80ad0-1518-462b-92e0-0ca4ec287d4b tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:06.256178 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-816491e2-987a-4b20-9e66-ef04edd7a0da tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.153770 Aug 02 11:00:06.257259 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 301/595] 10.222.0.115 () {60 vars in 1164 bytes} [Tue Aug 2 11:00:06 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 11:00:06.356823 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-93b80ad0-1518-462b-92e0-0ca4ec287d4b tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:06.368441 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-93b80ad0-1518-462b-92e0-0ca4ec287d4b tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a" status: 200 len: 1740 microversion: 2.1 time: 0.185427 Aug 02 11:00:06.369491 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 295/596] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:00:06 2022] GET /compute/v2.1/servers/8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a => generated 1740 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 11:00:06.655284 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-10897644-3c0b-4e08-b5ad-faadd9415c35 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:06.655904 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-10897644-3c0b-4e08-b5ad-faadd9415c35 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] [instance: 93775f02-e62c-4392-a1ed-cfd5dd956dd7] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:06.662380 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-10897644-3c0b-4e08-b5ad-faadd9415c35 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:06.662828 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-10897644-3c0b-4e08-b5ad-faadd9415c35 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:06.663627 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-10897644-3c0b-4e08-b5ad-faadd9415c35 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:06.664066 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-10897644-3c0b-4e08-b5ad-faadd9415c35 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:06.804734 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-10897644-3c0b-4e08-b5ad-faadd9415c35 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f41f17f5154e01a699043edc350cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e92110a1545f1b84644b8971bb6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:06.825977 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-10897644-3c0b-4e08-b5ad-faadd9415c35 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] 10.222.0.115 "GET /compute/v2.1/servers/93775f02-e62c-4392-a1ed-cfd5dd956dd7" status: 200 len: 1365 microversion: 2.1 time: 0.174975 Aug 02 11:00:06.826937 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 302/597] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:00:06 2022] GET /compute/v2.1/servers/93775f02-e62c-4392-a1ed-cfd5dd956dd7 => generated 1365 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:00:07.392287 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-ca91ff3b-c240-4912-81ce-69e17cfff23a tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:07.393366 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-ca91ff3b-c240-4912-81ce-69e17cfff23a tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:07.400218 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-ca91ff3b-c240-4912-81ce-69e17cfff23a tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:07.401088 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-ca91ff3b-c240-4912-81ce-69e17cfff23a tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:07.401894 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-ca91ff3b-c240-4912-81ce-69e17cfff23a tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:07.402309 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-ca91ff3b-c240-4912-81ce-69e17cfff23a tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:07.537700 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-ca91ff3b-c240-4912-81ce-69e17cfff23a tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:07.545990 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-ca91ff3b-c240-4912-81ce-69e17cfff23a tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a" status: 200 len: 1740 microversion: 2.1 time: 0.157652 Aug 02 11:00:07.546654 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 296/598] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:00:07 2022] GET /compute/v2.1/servers/8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a => generated 1740 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:00:07.848468 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-bb863b1a-f8a4-405d-a638-2cb303eccb57 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:07.849085 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-bb863b1a-f8a4-405d-a638-2cb303eccb57 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] [instance: 93775f02-e62c-4392-a1ed-cfd5dd956dd7] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:07.856667 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-bb863b1a-f8a4-405d-a638-2cb303eccb57 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:07.857254 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-bb863b1a-f8a4-405d-a638-2cb303eccb57 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:07.858052 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-bb863b1a-f8a4-405d-a638-2cb303eccb57 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:07.858492 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-bb863b1a-f8a4-405d-a638-2cb303eccb57 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:08.015136 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-bb863b1a-f8a4-405d-a638-2cb303eccb57 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f41f17f5154e01a699043edc350cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e92110a1545f1b84644b8971bb6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:08.026762 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-bb863b1a-f8a4-405d-a638-2cb303eccb57 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] 10.222.0.115 "GET /compute/v2.1/servers/93775f02-e62c-4392-a1ed-cfd5dd956dd7" status: 200 len: 1365 microversion: 2.1 time: 0.182006 Aug 02 11:00:08.027816 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 303/599] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:00:07 2022] GET /compute/v2.1/servers/93775f02-e62c-4392-a1ed-cfd5dd956dd7 => generated 1365 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:00:08.567993 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-95c8e496-fdda-4491-87ba-d4f1a1ebe95a tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:08.568577 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-95c8e496-fdda-4491-87ba-d4f1a1ebe95a tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:08.575347 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-95c8e496-fdda-4491-87ba-d4f1a1ebe95a tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:08.575797 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-95c8e496-fdda-4491-87ba-d4f1a1ebe95a tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:08.576575 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-95c8e496-fdda-4491-87ba-d4f1a1ebe95a tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:08.577088 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-95c8e496-fdda-4491-87ba-d4f1a1ebe95a tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:08.718298 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-95c8e496-fdda-4491-87ba-d4f1a1ebe95a tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:08.724871 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-95c8e496-fdda-4491-87ba-d4f1a1ebe95a tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a" status: 200 len: 1740 microversion: 2.1 time: 0.160846 Aug 02 11:00:08.725442 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 297/600] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:00:08 2022] GET /compute/v2.1/servers/8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a => generated 1740 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:00:08.726269 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-6e8b015b-4e2d-4187-8f8a-dc2c55089a41 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1065446865", "imageRef": "aa0a7b8c-0dd6-4803-8767-cb8c2d05fdd4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "aafffa4e-4cec-4281-b3a0-ebe26470b35c"}], "security_groups": [{"name": "tempest-securitygroup--1726372621"}], "key_name": "tempest-keypair-205189833", "user_data": "}} {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 11:00:08.831933 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.network.neutron [None req-6e8b015b-4e2d-4187-8f8a-dc2c55089a41 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] validate_networks() for [('aafffa4e-4cec-4281-b3a0-ebe26470b35c', None, None, None, None, None)] {{(pid=129953) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 11:00:09.048918 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-3c492241-7454-4be1-8db7-b153869824b9 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:09.049674 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-3c492241-7454-4be1-8db7-b153869824b9 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] [instance: 93775f02-e62c-4392-a1ed-cfd5dd956dd7] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:09.055851 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-3c492241-7454-4be1-8db7-b153869824b9 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:09.056302 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-3c492241-7454-4be1-8db7-b153869824b9 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:09.057070 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-3c492241-7454-4be1-8db7-b153869824b9 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:09.057506 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-3c492241-7454-4be1-8db7-b153869824b9 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:09.272217 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-3c492241-7454-4be1-8db7-b153869824b9 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f41f17f5154e01a699043edc350cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e92110a1545f1b84644b8971bb6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:09.280347 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-3c492241-7454-4be1-8db7-b153869824b9 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] 10.222.0.115 "GET /compute/v2.1/servers/93775f02-e62c-4392-a1ed-cfd5dd956dd7" status: 200 len: 1365 microversion: 2.1 time: 0.235427 Aug 02 11:00:09.280923 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 298/601] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:00:09 2022] GET /compute/v2.1/servers/93775f02-e62c-4392-a1ed-cfd5dd956dd7 => generated 1365 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 11:00:09.287281 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.virt.hardware [None req-6e8b015b-4e2d-4187-8f8a-dc2c55089a41 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Flavor limits 0:0:0 {{(pid=129953) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 11:00:09.287854 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.virt.hardware [None req-6e8b015b-4e2d-4187-8f8a-dc2c55089a41 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Image limits 0:0:0 {{(pid=129953) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 11:00:09.288257 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.virt.hardware [None req-6e8b015b-4e2d-4187-8f8a-dc2c55089a41 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Flavor pref 0:0:0 {{(pid=129953) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 11:00:09.288713 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.virt.hardware [None req-6e8b015b-4e2d-4187-8f8a-dc2c55089a41 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Image pref 0:0:0 {{(pid=129953) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 11:00:09.289154 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.virt.hardware [None req-6e8b015b-4e2d-4187-8f8a-dc2c55089a41 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129953) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 11:00:09.298190 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-6e8b015b-4e2d-4187-8f8a-dc2c55089a41 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:09.298632 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-6e8b015b-4e2d-4187-8f8a-dc2c55089a41 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:09.299458 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-6e8b015b-4e2d-4187-8f8a-dc2c55089a41 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:09.299895 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-6e8b015b-4e2d-4187-8f8a-dc2c55089a41 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:09.316962 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.quota [None req-6e8b015b-4e2d-4187-8f8a-dc2c55089a41 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Getting quotas for project 89a4a0cf1852449e8bfc59ddb5a902c1. Resources: {'instances', 'cores', 'ram'} {{(pid=129953) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 11:00:09.321927 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.quota [None req-6e8b015b-4e2d-4187-8f8a-dc2c55089a41 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Getting quotas for user 53bc14ada1564911b2f0a698aef3f333 and project 89a4a0cf1852449e8bfc59ddb5a902c1. Resources: {'instances', 'cores', 'ram'} {{(pid=129953) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 11:00:09.333612 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-6e8b015b-4e2d-4187-8f8a-dc2c55089a41 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Going to run 1 instances... {{(pid=129953) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 11:00:09.335930 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-6e8b015b-4e2d-4187-8f8a-dc2c55089a41 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: 07d63415-e151-4b2f-93ff-0769c401f16b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aa0a7b8c-0dd6-4803-8767-cb8c2d05fdd4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129953) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 11:00:09.361996 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG dbcounter [-] [129953] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=129953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 11:00:09.452722 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-6e8b015b-4e2d-4187-8f8a-dc2c55089a41 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.730664 Aug 02 11:00:09.453496 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 304/602] 10.222.0.115 () {60 vars in 1152 bytes} [Tue Aug 2 11:00:08 2022] POST /compute/v2.1/servers => generated 404 bytes in 732 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Aug 02 11:00:09.464555 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-4d85fcef-66cf-45c2-9c5b-5a45ed7752fc tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:09.465208 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-4d85fcef-66cf-45c2-9c5b-5a45ed7752fc tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: 07d63415-e151-4b2f-93ff-0769c401f16b] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:09.520166 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-4d85fcef-66cf-45c2-9c5b-5a45ed7752fc tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bc14ada1564911b2f0a698aef3f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a4a0cf1852449e8bfc59ddb5a902c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:09.527034 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-4d85fcef-66cf-45c2-9c5b-5a45ed7752fc tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "GET /compute/v2.1/servers/07d63415-e151-4b2f-93ff-0769c401f16b" status: 200 len: 1245 microversion: 2.1 time: 0.066742 Aug 02 11:00:09.527633 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 299/603] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:00:09 2022] GET /compute/v2.1/servers/07d63415-e151-4b2f-93ff-0769c401f16b => generated 1245 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:00:09.746956 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-727aec50-c05c-4a93-bb8d-5e6e706caf32 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:09.747595 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-727aec50-c05c-4a93-bb8d-5e6e706caf32 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:09.753896 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-727aec50-c05c-4a93-bb8d-5e6e706caf32 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:09.754340 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-727aec50-c05c-4a93-bb8d-5e6e706caf32 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:09.755126 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-727aec50-c05c-4a93-bb8d-5e6e706caf32 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:09.755601 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-727aec50-c05c-4a93-bb8d-5e6e706caf32 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:09.892909 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-727aec50-c05c-4a93-bb8d-5e6e706caf32 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:09.899882 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-727aec50-c05c-4a93-bb8d-5e6e706caf32 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a" status: 200 len: 1740 microversion: 2.1 time: 0.157308 Aug 02 11:00:09.900494 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 305/604] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:00:09 2022] GET /compute/v2.1/servers/8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a => generated 1740 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:00:10.301832 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-4dc09a2d-8393-4d9b-a516-e75e1d3f1633 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:10.302528 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-4dc09a2d-8393-4d9b-a516-e75e1d3f1633 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] [instance: 93775f02-e62c-4392-a1ed-cfd5dd956dd7] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:10.311350 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-4dc09a2d-8393-4d9b-a516-e75e1d3f1633 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:10.313747 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-4dc09a2d-8393-4d9b-a516-e75e1d3f1633 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:10.313747 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-4dc09a2d-8393-4d9b-a516-e75e1d3f1633 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:10.313747 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-4dc09a2d-8393-4d9b-a516-e75e1d3f1633 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:10.460692 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-4dc09a2d-8393-4d9b-a516-e75e1d3f1633 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f41f17f5154e01a699043edc350cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e92110a1545f1b84644b8971bb6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:10.469631 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-4dc09a2d-8393-4d9b-a516-e75e1d3f1633 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] 10.222.0.115 "GET /compute/v2.1/servers/93775f02-e62c-4392-a1ed-cfd5dd956dd7" status: 200 len: 1551 microversion: 2.1 time: 0.171777 Aug 02 11:00:10.470548 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 300/605] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:00:10 2022] GET /compute/v2.1/servers/93775f02-e62c-4392-a1ed-cfd5dd956dd7 => generated 1551 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:00:10.495779 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-bb2a55f7-0e2b-4fe1-8ecb-0b3e7cc8d6c9 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:10.496387 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-bb2a55f7-0e2b-4fe1-8ecb-0b3e7cc8d6c9 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] [instance: 93775f02-e62c-4392-a1ed-cfd5dd956dd7] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:10.502902 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-bb2a55f7-0e2b-4fe1-8ecb-0b3e7cc8d6c9 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:10.503408 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-bb2a55f7-0e2b-4fe1-8ecb-0b3e7cc8d6c9 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:10.504180 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-bb2a55f7-0e2b-4fe1-8ecb-0b3e7cc8d6c9 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:10.504623 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-bb2a55f7-0e2b-4fe1-8ecb-0b3e7cc8d6c9 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:10.600277 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-bb2a55f7-0e2b-4fe1-8ecb-0b3e7cc8d6c9 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] 10.222.0.115 "GET /compute/v2.1/servers/93775f02-e62c-4392-a1ed-cfd5dd956dd7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.109591 Aug 02 11:00:10.601167 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 306/606] 10.222.0.115 () {58 vars in 1280 bytes} [Tue Aug 2 11:00:10 2022] GET /compute/v2.1/servers/93775f02-e62c-4392-a1ed-cfd5dd956dd7/os-interface => generated 284 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 11:00:10.618154 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-bbf644e8-3830-430a-af17-ee8819af1c65 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:10.618894 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-bbf644e8-3830-430a-af17-ee8819af1c65 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: 07d63415-e151-4b2f-93ff-0769c401f16b] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:10.622015 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG dbcounter [-] [129952] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 11:00:10.626152 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-bbf644e8-3830-430a-af17-ee8819af1c65 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:10.626599 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-bbf644e8-3830-430a-af17-ee8819af1c65 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:10.627407 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-bbf644e8-3830-430a-af17-ee8819af1c65 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:10.627899 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-bbf644e8-3830-430a-af17-ee8819af1c65 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:10.685050 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-6dd8b885-5fe3-405c-ba9c-ebf1324fc6d9 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:10.685945 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-6dd8b885-5fe3-405c-ba9c-ebf1324fc6d9 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] [instance: eb175839-504d-4d07-b576-d51202b9ccae] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:10.693403 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-6dd8b885-5fe3-405c-ba9c-ebf1324fc6d9 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:10.693973 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-6dd8b885-5fe3-405c-ba9c-ebf1324fc6d9 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:10.694652 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-6dd8b885-5fe3-405c-ba9c-ebf1324fc6d9 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:10.695844 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-6dd8b885-5fe3-405c-ba9c-ebf1324fc6d9 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:10.716405 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG dbcounter [-] [129953] Writing DB stats nova_cell1:SELECT=100 {{(pid=129953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 11:00:10.724200 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-6dd8b885-5fe3-405c-ba9c-ebf1324fc6d9 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] [instance: eb175839-504d-4d07-b576-d51202b9ccae] Going to try to terminate instance {{(pid=129953) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 11:00:10.756986 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-bbf644e8-3830-430a-af17-ee8819af1c65 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bc14ada1564911b2f0a698aef3f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a4a0cf1852449e8bfc59ddb5a902c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:10.767459 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-bbf644e8-3830-430a-af17-ee8819af1c65 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "GET /compute/v2.1/servers/07d63415-e151-4b2f-93ff-0769c401f16b" status: 200 len: 1249 microversion: 2.1 time: 0.222509 Aug 02 11:00:10.768052 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 301/607] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:00:10 2022] GET /compute/v2.1/servers/07d63415-e151-4b2f-93ff-0769c401f16b => generated 1249 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 11:00:10.922205 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-bd07b11c-8691-4fbe-8e4f-06bcbf26ca51 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:10.922824 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-bd07b11c-8691-4fbe-8e4f-06bcbf26ca51 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:10.929980 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-bd07b11c-8691-4fbe-8e4f-06bcbf26ca51 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:10.930573 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-bd07b11c-8691-4fbe-8e4f-06bcbf26ca51 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:10.931501 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-bd07b11c-8691-4fbe-8e4f-06bcbf26ca51 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:10.931943 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-bd07b11c-8691-4fbe-8e4f-06bcbf26ca51 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:11.068431 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-6dd8b885-5fe3-405c-ba9c-ebf1324fc6d9 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] 10.222.0.115 "DELETE /compute/v2.1/servers/eb175839-504d-4d07-b576-d51202b9ccae" status: 204 len: 0 microversion: 2.1 time: 0.388288 Aug 02 11:00:11.069632 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 307/608] 10.222.0.115 () {58 vars in 1244 bytes} [Tue Aug 2 11:00:10 2022] DELETE /compute/v2.1/servers/eb175839-504d-4d07-b576-d51202b9ccae => generated 0 bytes in 391 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 11:00:11.079267 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-1fff033d-26e7-4251-bfc9-7d7c5264d0d7 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:11.079837 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-1fff033d-26e7-4251-bfc9-7d7c5264d0d7 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] [instance: eb175839-504d-4d07-b576-d51202b9ccae] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:11.086307 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-1fff033d-26e7-4251-bfc9-7d7c5264d0d7 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:11.087501 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-1fff033d-26e7-4251-bfc9-7d7c5264d0d7 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:11.096156 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-1fff033d-26e7-4251-bfc9-7d7c5264d0d7 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:11.106009 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-1fff033d-26e7-4251-bfc9-7d7c5264d0d7 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:11.249219 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-bd07b11c-8691-4fbe-8e4f-06bcbf26ca51 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:11.257584 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-bd07b11c-8691-4fbe-8e4f-06bcbf26ca51 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a" status: 200 len: 1720 microversion: 2.1 time: 0.339316 Aug 02 11:00:11.258178 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 302/609] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:00:10 2022] GET /compute/v2.1/servers/8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a => generated 1720 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 11:00:11.320776 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-3901436d-8483-463d-86cf-6c6151667551 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:11.322107 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-3901436d-8483-463d-86cf-6c6151667551 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:11.330130 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-3901436d-8483-463d-86cf-6c6151667551 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:11.330574 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-3901436d-8483-463d-86cf-6c6151667551 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:11.331382 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-3901436d-8483-463d-86cf-6c6151667551 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:11.331812 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-3901436d-8483-463d-86cf-6c6151667551 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:11.339148 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-1fff033d-26e7-4251-bfc9-7d7c5264d0d7 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914de37664914b4cb91e0ce2c3a0e1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66234794284419a47e3afcae968084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:11.347329 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-1fff033d-26e7-4251-bfc9-7d7c5264d0d7 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] 10.222.0.115 "GET /compute/v2.1/servers/eb175839-504d-4d07-b576-d51202b9ccae" status: 200 len: 1581 microversion: 2.1 time: 0.272413 Aug 02 11:00:11.347893 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 308/610] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:00:11 2022] GET /compute/v2.1/servers/eb175839-504d-4d07-b576-d51202b9ccae => generated 1581 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 11:00:11.420535 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.wsgi [None req-3901436d-8483-463d-86cf-6c6151667551 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] HTTP exception thrown: Cannot 'detach_volume' instance 8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a while it is in vm_state rescued Aug 02 11:00:11.422260 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-3901436d-8483-463d-86cf-6c6151667551 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Request method failure captured: Aug 02 11:00:11.422260 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: request: DELETE /compute/v2.1/servers/8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a/os-volume_attachments/82f4a931-697f-48ed-9700-45cd2f48f1a1 HTTP/1.1 Aug 02 11:00:11.422260 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Accept: application/json Aug 02 11:00:11.422260 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Accept-Encoding: identity Aug 02 11:00:11.422260 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Connection: close Aug 02 11:00:11.422260 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Content-Length: 0 Aug 02 11:00:11.422260 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Content-Type: application/json Aug 02 11:00:11.422260 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Host: 10.222.0.115 Aug 02 11:00:11.422260 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Openstack-System-Scope: None Aug 02 11:00:11.422260 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: User-Agent: python-urllib3/1.26.10 Aug 02 11:00:11.422260 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Auth-Token: gAAAAABi6QLU4-kFVceoHWEpo94bbvBf1uqlEx4Gmz_ix8LIhs0hb3WYrUk_oMQ3oj3o3ZEWUh1MDl3j04cDaiOxlt6Nmx19h9H9o9YzMFcctjtmr66KQ4MTn2pZ5x6hWud4Dyg2XcQVpsrwtFErHKVVnsJz6A5M7HawuEHdbt-qhQJOR6Lin2k Aug 02 11:00:11.422260 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Domain-Id: None Aug 02 11:00:11.422260 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Domain-Name: None Aug 02 11:00:11.422260 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Identity-Status: Confirmed Aug 02 11:00:11.422260 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Is-Admin-Project: True Aug 02 11:00:11.422260 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Project-Domain-Id: default Aug 02 11:00:11.422260 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Project-Domain-Name: Default Aug 02 11:00:11.422260 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Project-Id: 0d99d3fd13df429a8ee8a7cb7780adb5 Aug 02 11:00:11.422260 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1563347873 Aug 02 11:00:11.422260 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Role: reader,member Aug 02 11:00:11.422260 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Roles: reader,member Aug 02 11:00:11.423992 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/0d99d3fd13df429a8ee8a7cb7780adb5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2/0d99d3fd13df429a8ee8a7cb7780adb5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/0d99d3fd13df429a8ee8a7cb7780adb5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.115:8080", "publicURL": "http://10.222.0.115:8080/v1/AUTH_0d99d3fd13df429a8ee8a7cb7780adb5"}]}] Aug 02 11:00:11.423992 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1563347873 Aug 02 11:00:11.423992 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Tenant-Id: 0d99d3fd13df429a8ee8a7cb7780adb5 Aug 02 11:00:11.423992 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1563347873 Aug 02 11:00:11.423992 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User: tempest-ServerRescueNegativeTestJSON-1563347873-project Aug 02 11:00:11.423992 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User-Domain-Id: default Aug 02 11:00:11.423992 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User-Domain-Name: Default Aug 02 11:00:11.423992 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User-Id: 3057a53debc34c829372c03567e1119d Aug 02 11:00:11.423992 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1563347873-project Aug 02 11:00:11.423992 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: method: > Aug 02 11:00:11.423992 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: exception: Cannot 'detach_volume' instance 8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a while it is in vm_state rescued Aug 02 11:00:11.424866 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: action_args: {'server_id': '8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a', 'id': '82f4a931-697f-48ed-9700-45cd2f48f1a1'} Aug 02 11:00:11.424866 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 11:00:11.424866 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:00:11.424866 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 02 11:00:11.424866 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 02 11:00:11.424866 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 02 11:00:11.424866 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 02 11:00:11.424866 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 02 11:00:11.424866 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 02 11:00:11.424866 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 02 11:00:11.424866 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 11:00:11.424866 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 11:00:11.424866 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 11:00:11.424866 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:00:11.424866 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 11:00:11.424866 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 11:00:11.424866 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 11:00:11.424866 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 11:00:11.424866 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 11:00:11.424866 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 11:00:11.426320 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 02 11:00:11.426320 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 02 11:00:11.426320 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 02 11:00:11.426320 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 02 11:00:11.426320 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a while it is in vm_state rescued Aug 02 11:00:11.426320 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 11:00:11.426320 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 11:00:11.426320 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 11:00:11.426320 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:00:11.426320 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 11:00:11.426320 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 11:00:11.426320 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 11:00:11.426320 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 11:00:11.426320 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a while it is in vm_state rescued Aug 02 11:00:11.426320 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 11:00:11.426320 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-3901436d-8483-463d-86cf-6c6151667551 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Returning 409 to user: Cannot 'detach_volume' instance 8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a while it is in vm_state rescued {{(pid=129952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 11:00:11.427533 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-3901436d-8483-463d-86cf-6c6151667551 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "DELETE /compute/v2.1/servers/8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a/os-volume_attachments/82f4a931-697f-48ed-9700-45cd2f48f1a1" status: 409 len: 152 microversion: 2.1 time: 0.107025 Aug 02 11:00:11.427533 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 303/611] 10.222.0.115 () {58 vars in 1421 bytes} [Tue Aug 2 11:00:11 2022] DELETE /compute/v2.1/servers/8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a/os-volume_attachments/82f4a931-697f-48ed-9700-45cd2f48f1a1 => generated 152 bytes in 108 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 02 11:00:11.438023 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-ff215d56-1291-46cb-b707-4df983cbfcb1 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 11:00:11.438823 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-ff215d56-1291-46cb-b707-4df983cbfcb1 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:11.445263 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-ff215d56-1291-46cb-b707-4df983cbfcb1 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:11.445709 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-ff215d56-1291-46cb-b707-4df983cbfcb1 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:11.447420 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-ff215d56-1291-46cb-b707-4df983cbfcb1 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:11.447857 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-ff215d56-1291-46cb-b707-4df983cbfcb1 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:11.660493 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-ff215d56-1291-46cb-b707-4df983cbfcb1 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "POST /compute/v2.1/servers/8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a/action" status: 202 len: 0 microversion: 2.1 time: 0.231506 Aug 02 11:00:11.661210 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 309/612] 10.222.0.115 () {60 vars in 1283 bytes} [Tue Aug 2 11:00:11 2022] POST /compute/v2.1/servers/8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a/action => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 11:00:11.669590 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-dd562871-2df5-41f0-9b09-66cea95a0541 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:11.670223 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-dd562871-2df5-41f0-9b09-66cea95a0541 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:11.677283 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-dd562871-2df5-41f0-9b09-66cea95a0541 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:11.677735 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-dd562871-2df5-41f0-9b09-66cea95a0541 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:11.678534 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-dd562871-2df5-41f0-9b09-66cea95a0541 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:11.679681 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-dd562871-2df5-41f0-9b09-66cea95a0541 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:11.794425 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-10644cad-a383-460b-9cbd-810c8c32b291 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:11.795157 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-10644cad-a383-460b-9cbd-810c8c32b291 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: 07d63415-e151-4b2f-93ff-0769c401f16b] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:11.802260 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-10644cad-a383-460b-9cbd-810c8c32b291 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:11.809652 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-10644cad-a383-460b-9cbd-810c8c32b291 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:11.809652 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-10644cad-a383-460b-9cbd-810c8c32b291 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:11.809652 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-10644cad-a383-460b-9cbd-810c8c32b291 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:11.899637 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-10644cad-a383-460b-9cbd-810c8c32b291 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bc14ada1564911b2f0a698aef3f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a4a0cf1852449e8bfc59ddb5a902c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:11.907742 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-10644cad-a383-460b-9cbd-810c8c32b291 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "GET /compute/v2.1/servers/07d63415-e151-4b2f-93ff-0769c401f16b" status: 200 len: 1297 microversion: 2.1 time: 0.118368 Aug 02 11:00:11.908321 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 310/613] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:00:11 2022] GET /compute/v2.1/servers/07d63415-e151-4b2f-93ff-0769c401f16b => generated 1297 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 11:00:12.047906 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-dd562871-2df5-41f0-9b09-66cea95a0541 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:12.052999 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-dd562871-2df5-41f0-9b09-66cea95a0541 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a" status: 200 len: 1728 microversion: 2.1 time: 0.387320 Aug 02 11:00:12.053775 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 304/614] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:00:11 2022] GET /compute/v2.1/servers/8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a => generated 1728 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:00:12.212863 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [req-ba8367a8-fab8-4968-8ebd-6e2daca88334 req-11f5c12e-da8f-4f56-9bbc-0f65ee926279 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93775f02-e62c-4392-a1ed-cfd5dd956dd7", "tag": "571a2e00-abb0-4402-8c1a-59fe26898cf1"}]} {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 11:00:12.222574 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [req-ba8367a8-fab8-4968-8ebd-6e2daca88334 req-11f5c12e-da8f-4f56-9bbc-0f65ee926279 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:12.223086 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [req-ba8367a8-fab8-4968-8ebd-6e2daca88334 req-11f5c12e-da8f-4f56-9bbc-0f65ee926279 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:12.237894 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.compute.server_external_events [req-ba8367a8-fab8-4968-8ebd-6e2daca88334 req-11f5c12e-da8f-4f56-9bbc-0f65ee926279 service nova] Creating event network-changed:571a2e00-abb0-4402-8c1a-59fe26898cf1 for instance 93775f02-e62c-4392-a1ed-cfd5dd956dd7 on hv-cinder-85031 Aug 02 11:00:12.243798 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [req-ba8367a8-fab8-4968-8ebd-6e2daca88334 req-11f5c12e-da8f-4f56-9bbc-0f65ee926279 service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035247 Aug 02 11:00:12.244831 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 311/615] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Aug 2 11:00:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 11:00:12.370088 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-385a3670-1d7e-42ec-8ba8-6cd2110fb16b tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:12.370689 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-385a3670-1d7e-42ec-8ba8-6cd2110fb16b tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] [instance: eb175839-504d-4d07-b576-d51202b9ccae] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:12.376987 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-385a3670-1d7e-42ec-8ba8-6cd2110fb16b tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:12.377434 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-385a3670-1d7e-42ec-8ba8-6cd2110fb16b tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:12.378396 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-385a3670-1d7e-42ec-8ba8-6cd2110fb16b tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:12.378832 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-385a3670-1d7e-42ec-8ba8-6cd2110fb16b tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:12.382870 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG dbcounter [-] [129952] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=129952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 11:00:12.526257 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-a103d8f7-cd88-44b8-8eb7-ee9bf4557417 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:12.527230 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-a103d8f7-cd88-44b8-8eb7-ee9bf4557417 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: f86a8852-12b8-46d3-bd9b-bc140757b4c5] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:12.534411 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-385a3670-1d7e-42ec-8ba8-6cd2110fb16b tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914de37664914b4cb91e0ce2c3a0e1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66234794284419a47e3afcae968084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:12.534568 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-a103d8f7-cd88-44b8-8eb7-ee9bf4557417 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:12.534903 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-a103d8f7-cd88-44b8-8eb7-ee9bf4557417 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:12.535733 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-a103d8f7-cd88-44b8-8eb7-ee9bf4557417 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:12.536163 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-a103d8f7-cd88-44b8-8eb7-ee9bf4557417 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:12.549629 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-385a3670-1d7e-42ec-8ba8-6cd2110fb16b tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] 10.222.0.115 "GET /compute/v2.1/servers/eb175839-504d-4d07-b576-d51202b9ccae" status: 200 len: 1581 microversion: 2.1 time: 0.183781 Aug 02 11:00:12.559229 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 305/616] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:00:12 2022] GET /compute/v2.1/servers/eb175839-504d-4d07-b576-d51202b9ccae => generated 1581 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:00:12.566287 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-a103d8f7-cd88-44b8-8eb7-ee9bf4557417 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5/ips" status: 200 len: 152 microversion: 2.20 time: 0.112685 Aug 02 11:00:12.571548 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 312/617] 10.222.0.115 () {60 vars in 1294 bytes} [Tue Aug 2 11:00:12 2022] GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5/ips => generated 152 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 11:00:12.934792 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-f55a414f-5b8f-41e2-8673-5c3eb172d476 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:12.937283 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-f55a414f-5b8f-41e2-8673-5c3eb172d476 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: 07d63415-e151-4b2f-93ff-0769c401f16b] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:12.957625 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-f55a414f-5b8f-41e2-8673-5c3eb172d476 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:12.959833 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-f55a414f-5b8f-41e2-8673-5c3eb172d476 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:12.975140 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-f55a414f-5b8f-41e2-8673-5c3eb172d476 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:12.978951 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-f55a414f-5b8f-41e2-8673-5c3eb172d476 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:13.074994 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-d1d84d78-6048-4621-a1dc-a9988badf3ce tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:13.076596 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-d1d84d78-6048-4621-a1dc-a9988badf3ce tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:13.086996 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-d1d84d78-6048-4621-a1dc-a9988badf3ce tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:13.087605 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-d1d84d78-6048-4621-a1dc-a9988badf3ce tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:13.088554 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-d1d84d78-6048-4621-a1dc-a9988badf3ce tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:13.089153 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-d1d84d78-6048-4621-a1dc-a9988badf3ce tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:13.148379 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-f55a414f-5b8f-41e2-8673-5c3eb172d476 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bc14ada1564911b2f0a698aef3f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a4a0cf1852449e8bfc59ddb5a902c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:13.158233 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-f55a414f-5b8f-41e2-8673-5c3eb172d476 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "GET /compute/v2.1/servers/07d63415-e151-4b2f-93ff-0769c401f16b" status: 200 len: 1305 microversion: 2.1 time: 0.231824 Aug 02 11:00:13.175649 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 306/618] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:00:12 2022] GET /compute/v2.1/servers/07d63415-e151-4b2f-93ff-0769c401f16b => generated 1305 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:00:13.505457 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-d1d84d78-6048-4621-a1dc-a9988badf3ce tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:13.525508 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-d1d84d78-6048-4621-a1dc-a9988badf3ce tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a" status: 200 len: 1728 microversion: 2.1 time: 0.455302 Aug 02 11:00:13.526481 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 313/619] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:00:13 2022] GET /compute/v2.1/servers/8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a => generated 1728 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 11:00:13.571768 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-bf57ca3f-41d7-4966-a98f-e506e2f95f2d tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:13.572991 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-bf57ca3f-41d7-4966-a98f-e506e2f95f2d tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] [instance: eb175839-504d-4d07-b576-d51202b9ccae] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:13.580163 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-bf57ca3f-41d7-4966-a98f-e506e2f95f2d tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:13.580536 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-bf57ca3f-41d7-4966-a98f-e506e2f95f2d tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:13.581309 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-bf57ca3f-41d7-4966-a98f-e506e2f95f2d tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:13.581907 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-bf57ca3f-41d7-4966-a98f-e506e2f95f2d tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:13.883188 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-bf57ca3f-41d7-4966-a98f-e506e2f95f2d tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914de37664914b4cb91e0ce2c3a0e1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66234794284419a47e3afcae968084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:13.890889 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-bf57ca3f-41d7-4966-a98f-e506e2f95f2d tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] 10.222.0.115 "GET /compute/v2.1/servers/eb175839-504d-4d07-b576-d51202b9ccae" status: 200 len: 1581 microversion: 2.1 time: 0.323431 Aug 02 11:00:13.892144 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 307/620] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:00:13 2022] GET /compute/v2.1/servers/eb175839-504d-4d07-b576-d51202b9ccae => generated 1581 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:00:14.184969 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-b13a8c12-614c-4833-84e4-1bd64a03a080 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:14.185512 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-b13a8c12-614c-4833-84e4-1bd64a03a080 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: 07d63415-e151-4b2f-93ff-0769c401f16b] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:14.192179 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-b13a8c12-614c-4833-84e4-1bd64a03a080 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:14.192625 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-b13a8c12-614c-4833-84e4-1bd64a03a080 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:14.193385 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-b13a8c12-614c-4833-84e4-1bd64a03a080 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:14.193813 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-b13a8c12-614c-4833-84e4-1bd64a03a080 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:14.462585 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-b13a8c12-614c-4833-84e4-1bd64a03a080 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bc14ada1564911b2f0a698aef3f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a4a0cf1852449e8bfc59ddb5a902c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:14.471320 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-b13a8c12-614c-4833-84e4-1bd64a03a080 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "GET /compute/v2.1/servers/07d63415-e151-4b2f-93ff-0769c401f16b" status: 200 len: 1371 microversion: 2.1 time: 0.290746 Aug 02 11:00:14.472239 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 314/621] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:00:14 2022] GET /compute/v2.1/servers/07d63415-e151-4b2f-93ff-0769c401f16b => generated 1371 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:00:14.549199 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-901addd5-43f9-4071-b8ec-0e38a765663a tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:14.549873 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-901addd5-43f9-4071-b8ec-0e38a765663a tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:14.558067 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-901addd5-43f9-4071-b8ec-0e38a765663a tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:14.558522 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-901addd5-43f9-4071-b8ec-0e38a765663a tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:14.559382 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-901addd5-43f9-4071-b8ec-0e38a765663a tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:14.559825 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-901addd5-43f9-4071-b8ec-0e38a765663a tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:14.593245 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [req-2cb7fa5e-971e-40c6-99d1-b356eb777c85 req-4ac3774b-006c-4bb4-90d4-a774087b8831 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb175839-504d-4d07-b576-d51202b9ccae", "name": "network-vif-deleted", "tag": "801aec18-99a3-40f4-959b-068036dc0994"}]} {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 11:00:14.606235 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [req-2cb7fa5e-971e-40c6-99d1-b356eb777c85 req-4ac3774b-006c-4bb4-90d4-a774087b8831 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:14.606352 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [req-2cb7fa5e-971e-40c6-99d1-b356eb777c85 req-4ac3774b-006c-4bb4-90d4-a774087b8831 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:14.629639 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.compute.server_external_events [req-2cb7fa5e-971e-40c6-99d1-b356eb777c85 req-4ac3774b-006c-4bb4-90d4-a774087b8831 service nova] Creating event network-vif-deleted:801aec18-99a3-40f4-959b-068036dc0994 for instance eb175839-504d-4d07-b576-d51202b9ccae on hv-cinder-85031 Aug 02 11:00:14.635919 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [req-2cb7fa5e-971e-40c6-99d1-b356eb777c85 req-4ac3774b-006c-4bb4-90d4-a774087b8831 service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046414 Aug 02 11:00:14.636779 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 315/622] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Aug 2 11:00:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 11:00:14.733439 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-901addd5-43f9-4071-b8ec-0e38a765663a tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:14.743721 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-901addd5-43f9-4071-b8ec-0e38a765663a tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a" status: 200 len: 1728 microversion: 2.1 time: 0.198879 Aug 02 11:00:14.744322 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 308/623] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:00:14 2022] GET /compute/v2.1/servers/8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a => generated 1728 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:00:14.917270 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-72964e94-a5cd-402b-84ee-a27ed71347ba tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 11:00:14.920509 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-d39aa3ef-1e6c-4701-b53c-8db7f89d61b8 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:14.921113 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-72964e94-a5cd-402b-84ee-a27ed71347ba tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: f86a8852-12b8-46d3-bd9b-bc140757b4c5] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:14.924538 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-d39aa3ef-1e6c-4701-b53c-8db7f89d61b8 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] [instance: eb175839-504d-4d07-b576-d51202b9ccae] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:14.932058 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-72964e94-a5cd-402b-84ee-a27ed71347ba tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:14.932228 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-d39aa3ef-1e6c-4701-b53c-8db7f89d61b8 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:14.932507 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-72964e94-a5cd-402b-84ee-a27ed71347ba tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:14.932843 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-d39aa3ef-1e6c-4701-b53c-8db7f89d61b8 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:14.933283 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-72964e94-a5cd-402b-84ee-a27ed71347ba tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:14.933629 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-d39aa3ef-1e6c-4701-b53c-8db7f89d61b8 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:14.933734 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-72964e94-a5cd-402b-84ee-a27ed71347ba tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:14.934054 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-d39aa3ef-1e6c-4701-b53c-8db7f89d61b8 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:14.959787 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.objects.instance [None req-72964e94-a5cd-402b-84ee-a27ed71347ba tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lazy-loading 'flavor' on Instance uuid f86a8852-12b8-46d3-bd9b-bc140757b4c5 {{(pid=129952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 11:00:14.998674 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-d39aa3ef-1e6c-4701-b53c-8db7f89d61b8 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914de37664914b4cb91e0ce2c3a0e1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66234794284419a47e3afcae968084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:15.007002 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-d39aa3ef-1e6c-4701-b53c-8db7f89d61b8 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] 10.222.0.115 "GET /compute/v2.1/servers/eb175839-504d-4d07-b576-d51202b9ccae" status: 200 len: 1513 microversion: 2.1 time: 0.096655 Aug 02 11:00:15.007317 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 316/624] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:00:14 2022] GET /compute/v2.1/servers/eb175839-504d-4d07-b576-d51202b9ccae => generated 1513 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:00:15.420479 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-72964e94-a5cd-402b-84ee-a27ed71347ba tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "POST /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5/action" status: 202 len: 0 microversion: 2.20 time: 0.507417 Aug 02 11:00:15.421130 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 309/625] 10.222.0.115 () {62 vars in 1324 bytes} [Tue Aug 2 11:00:14 2022] POST /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5/action => generated 0 bytes in 509 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 02 11:00:15.429904 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-58326b0f-9a67-4b81-8917-66339c76c98d tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:15.431342 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-58326b0f-9a67-4b81-8917-66339c76c98d tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: f86a8852-12b8-46d3-bd9b-bc140757b4c5] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:15.441095 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-58326b0f-9a67-4b81-8917-66339c76c98d tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:15.441579 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-58326b0f-9a67-4b81-8917-66339c76c98d tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:15.442323 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-58326b0f-9a67-4b81-8917-66339c76c98d tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:15.442748 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-58326b0f-9a67-4b81-8917-66339c76c98d tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:15.495376 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-0df91057-5327-42c2-90ea-7e01a4551ed7 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:15.496239 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-0df91057-5327-42c2-90ea-7e01a4551ed7 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: 07d63415-e151-4b2f-93ff-0769c401f16b] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:15.503953 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-0df91057-5327-42c2-90ea-7e01a4551ed7 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:15.504478 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-0df91057-5327-42c2-90ea-7e01a4551ed7 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:15.505483 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-0df91057-5327-42c2-90ea-7e01a4551ed7 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:15.505972 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-0df91057-5327-42c2-90ea-7e01a4551ed7 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:15.765124 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-58326b0f-9a67-4b81-8917-66339c76c98d tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:15.787990 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-58326b0f-9a67-4b81-8917-66339c76c98d tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:15.790289 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-58326b0f-9a67-4b81-8917-66339c76c98d tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:15.791913 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-58326b0f-9a67-4b81-8917-66339c76c98d tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5" status: 200 len: 1727 microversion: 2.20 time: 0.366019 Aug 02 11:00:15.793450 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 317/626] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 11:00:15 2022] GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5 => generated 1727 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 11:00:15.798514 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-bde42711-5508-420a-a711-c9aad202dcb5 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:15.799328 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-bde42711-5508-420a-a711-c9aad202dcb5 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:15.809050 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-bde42711-5508-420a-a711-c9aad202dcb5 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:15.816442 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-bde42711-5508-420a-a711-c9aad202dcb5 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:15.816442 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-bde42711-5508-420a-a711-c9aad202dcb5 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:15.816442 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-bde42711-5508-420a-a711-c9aad202dcb5 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:15.828933 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-0df91057-5327-42c2-90ea-7e01a4551ed7 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bc14ada1564911b2f0a698aef3f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a4a0cf1852449e8bfc59ddb5a902c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:15.846237 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-0df91057-5327-42c2-90ea-7e01a4551ed7 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "GET /compute/v2.1/servers/07d63415-e151-4b2f-93ff-0769c401f16b" status: 200 len: 1371 microversion: 2.1 time: 0.356160 Aug 02 11:00:15.850410 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 310/627] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:00:15 2022] GET /compute/v2.1/servers/07d63415-e151-4b2f-93ff-0769c401f16b => generated 1371 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 11:00:16.010182 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-bde42711-5508-420a-a711-c9aad202dcb5 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:16.018998 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-bde42711-5508-420a-a711-c9aad202dcb5 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a" status: 200 len: 1728 microversion: 2.1 time: 0.224128 Aug 02 11:00:16.019697 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 318/628] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:00:15 2022] GET /compute/v2.1/servers/8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a => generated 1728 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:00:16.029354 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-0a4e33cd-5ce1-4564-b58a-27898afde875 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:16.030382 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-0a4e33cd-5ce1-4564-b58a-27898afde875 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] [instance: eb175839-504d-4d07-b576-d51202b9ccae] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:16.038247 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-0a4e33cd-5ce1-4564-b58a-27898afde875 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:16.038974 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-0a4e33cd-5ce1-4564-b58a-27898afde875 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:16.040838 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-0a4e33cd-5ce1-4564-b58a-27898afde875 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:16.041499 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-0a4e33cd-5ce1-4564-b58a-27898afde875 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:16.105281 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-0a4e33cd-5ce1-4564-b58a-27898afde875 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914de37664914b4cb91e0ce2c3a0e1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66234794284419a47e3afcae968084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:16.113096 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-0a4e33cd-5ce1-4564-b58a-27898afde875 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] 10.222.0.115 "GET /compute/v2.1/servers/eb175839-504d-4d07-b576-d51202b9ccae" status: 200 len: 1229 microversion: 2.1 time: 0.088172 Aug 02 11:00:16.113666 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 311/629] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:00:16 2022] GET /compute/v2.1/servers/eb175839-504d-4d07-b576-d51202b9ccae => generated 1229 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:00:16.465457 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [req-6b6ce594-618a-4aee-882d-196adc898544 req-7b0ce40d-0f36-4a3a-bf57-fb5214b59bb4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07d63415-e151-4b2f-93ff-0769c401f16b", "tag": "4e1594b0-146d-4aca-806b-5d9b5a8ab2c1"}]} {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 11:00:16.475877 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [req-6b6ce594-618a-4aee-882d-196adc898544 req-7b0ce40d-0f36-4a3a-bf57-fb5214b59bb4 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:16.476314 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [req-6b6ce594-618a-4aee-882d-196adc898544 req-7b0ce40d-0f36-4a3a-bf57-fb5214b59bb4 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:16.489971 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.compute.server_external_events [req-6b6ce594-618a-4aee-882d-196adc898544 req-7b0ce40d-0f36-4a3a-bf57-fb5214b59bb4 service nova] Creating event network-changed:4e1594b0-146d-4aca-806b-5d9b5a8ab2c1 for instance 07d63415-e151-4b2f-93ff-0769c401f16b on hv-cinder-85031 Aug 02 11:00:16.496162 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [req-6b6ce594-618a-4aee-882d-196adc898544 req-7b0ce40d-0f36-4a3a-bf57-fb5214b59bb4 service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034438 Aug 02 11:00:16.496537 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 319/630] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Aug 2 11:00:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 11:00:16.815680 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-32de60bf-9133-4737-82c3-5f781cb39e0e tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:16.816431 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-32de60bf-9133-4737-82c3-5f781cb39e0e tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: f86a8852-12b8-46d3-bd9b-bc140757b4c5] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:16.835317 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-32de60bf-9133-4737-82c3-5f781cb39e0e tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:16.837250 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-32de60bf-9133-4737-82c3-5f781cb39e0e tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:16.838638 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-32de60bf-9133-4737-82c3-5f781cb39e0e tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:16.839327 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-32de60bf-9133-4737-82c3-5f781cb39e0e tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:16.872720 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-35f6200e-8492-472d-b9c3-89e1cc3e17e5 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:16.873693 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-35f6200e-8492-472d-b9c3-89e1cc3e17e5 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: 07d63415-e151-4b2f-93ff-0769c401f16b] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:16.883000 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-35f6200e-8492-472d-b9c3-89e1cc3e17e5 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:16.884051 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-35f6200e-8492-472d-b9c3-89e1cc3e17e5 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:16.884968 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-35f6200e-8492-472d-b9c3-89e1cc3e17e5 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:16.885637 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-35f6200e-8492-472d-b9c3-89e1cc3e17e5 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:17.094109 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-32de60bf-9133-4737-82c3-5f781cb39e0e tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:17.114745 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-32de60bf-9133-4737-82c3-5f781cb39e0e tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:17.116560 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-32de60bf-9133-4737-82c3-5f781cb39e0e tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:17.117961 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-32de60bf-9133-4737-82c3-5f781cb39e0e tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5" status: 200 len: 1727 microversion: 2.20 time: 0.306366 Aug 02 11:00:17.118542 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 312/631] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 11:00:16 2022] GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5 => generated 1727 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 11:00:17.123459 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-70fa3c2e-bf77-433e-8a5f-fc32de02a142 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:17.124072 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-70fa3c2e-bf77-433e-8a5f-fc32de02a142 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:17.134717 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-70fa3c2e-bf77-433e-8a5f-fc32de02a142 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:17.139357 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-70fa3c2e-bf77-433e-8a5f-fc32de02a142 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:17.139357 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-70fa3c2e-bf77-433e-8a5f-fc32de02a142 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:17.139357 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-70fa3c2e-bf77-433e-8a5f-fc32de02a142 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:17.143852 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-35f6200e-8492-472d-b9c3-89e1cc3e17e5 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bc14ada1564911b2f0a698aef3f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a4a0cf1852449e8bfc59ddb5a902c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:17.152706 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-35f6200e-8492-472d-b9c3-89e1cc3e17e5 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "GET /compute/v2.1/servers/07d63415-e151-4b2f-93ff-0769c401f16b" status: 200 len: 1371 microversion: 2.1 time: 0.284490 Aug 02 11:00:17.153677 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 320/632] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:00:16 2022] GET /compute/v2.1/servers/07d63415-e151-4b2f-93ff-0769c401f16b => generated 1371 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 11:00:17.163204 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-11b61761-cf0f-4cb0-8a21-9777810dc76f tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:17.163204 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-11b61761-cf0f-4cb0-8a21-9777810dc76f tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] [instance: eb175839-504d-4d07-b576-d51202b9ccae] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:17.166024 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-11b61761-cf0f-4cb0-8a21-9777810dc76f tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:17.166693 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-11b61761-cf0f-4cb0-8a21-9777810dc76f tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:17.167719 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-11b61761-cf0f-4cb0-8a21-9777810dc76f tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:17.168366 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-11b61761-cf0f-4cb0-8a21-9777810dc76f tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:17.184012 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.wsgi [None req-11b61761-cf0f-4cb0-8a21-9777810dc76f tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] HTTP exception thrown: Instance eb175839-504d-4d07-b576-d51202b9ccae could not be found. Aug 02 11:00:17.186114 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-11b61761-cf0f-4cb0-8a21-9777810dc76f tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Request method failure captured: Aug 02 11:00:17.186114 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: request: GET /compute/v2.1/servers/eb175839-504d-4d07-b576-d51202b9ccae HTTP/1.1 Aug 02 11:00:17.186114 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Accept: application/json Aug 02 11:00:17.186114 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Accept-Encoding: identity Aug 02 11:00:17.186114 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Connection: close Aug 02 11:00:17.186114 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Content-Length: 0 Aug 02 11:00:17.186114 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Content-Type: application/json Aug 02 11:00:17.186114 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Host: 10.222.0.115 Aug 02 11:00:17.186114 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Openstack-System-Scope: None Aug 02 11:00:17.186114 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: User-Agent: python-urllib3/1.26.10 Aug 02 11:00:17.186114 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Auth-Token: gAAAAABi6QLq99om1OPWk1UijdLFE4rJ9tpb2cZBQAHRTgACTzCFftT30PxRbh5RhDYBxLkgEX_E-dzDxhNIcBXD70mTnMHeO4WPGCOlL9LKe34lSDb6brF9YXse81gOOuIm6GWNmPlYen1_XTIBq7GyPb3kwWB2BtnBJaDfo20Av8axtorTXVA Aug 02 11:00:17.186114 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Domain-Id: None Aug 02 11:00:17.186114 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Domain-Name: None Aug 02 11:00:17.186114 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Identity-Status: Confirmed Aug 02 11:00:17.186114 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Is-Admin-Project: True Aug 02 11:00:17.186114 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Project-Domain-Id: default Aug 02 11:00:17.186114 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Project-Domain-Name: Default Aug 02 11:00:17.186114 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Project-Id: be66234794284419a47e3afcae968084 Aug 02 11:00:17.186114 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Project-Name: tempest-TestVolumeBootPattern-1859072211 Aug 02 11:00:17.186114 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Role: reader,member Aug 02 11:00:17.186114 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Roles: reader,member Aug 02 11:00:17.187777 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/be66234794284419a47e3afcae968084"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2/be66234794284419a47e3afcae968084"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/be66234794284419a47e3afcae968084"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.115:8080", "publicURL": "http://10.222.0.115:8080/v1/AUTH_be66234794284419a47e3afcae968084"}]}] Aug 02 11:00:17.187777 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Tenant: tempest-TestVolumeBootPattern-1859072211 Aug 02 11:00:17.187777 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Tenant-Id: be66234794284419a47e3afcae968084 Aug 02 11:00:17.187777 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Tenant-Name: tempest-TestVolumeBootPattern-1859072211 Aug 02 11:00:17.187777 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User: tempest-TestVolumeBootPattern-1859072211-project Aug 02 11:00:17.187777 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User-Domain-Id: default Aug 02 11:00:17.187777 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User-Domain-Name: Default Aug 02 11:00:17.187777 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User-Id: 914de37664914b4cb91e0ce2c3a0e1d1 Aug 02 11:00:17.187777 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User-Name: tempest-TestVolumeBootPattern-1859072211-project Aug 02 11:00:17.187777 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: method: > Aug 02 11:00:17.187777 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: exception: Instance eb175839-504d-4d07-b576-d51202b9ccae could not be found. Aug 02 11:00:17.187777 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: action_args: {'id': 'eb175839-504d-4d07-b576-d51202b9ccae'} Aug 02 11:00:17.188691 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 11:00:17.188691 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:00:17.188691 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 11:00:17.188691 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 11:00:17.188691 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 11:00:17.188691 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 11:00:17.188691 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 11:00:17.188691 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 11:00:17.188691 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 11:00:17.188691 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 11:00:17.188691 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb175839-504d-4d07-b576-d51202b9ccae could not be found. Aug 02 11:00:17.188691 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 11:00:17.188691 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 11:00:17.188691 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 11:00:17.188691 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:00:17.188691 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 11:00:17.188691 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 11:00:17.188691 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 11:00:17.188691 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 11:00:17.188691 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 11:00:17.190130 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 11:00:17.190130 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 11:00:17.190130 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 11:00:17.190130 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 11:00:17.190130 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 11:00:17.190130 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 11:00:17.190130 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 11:00:17.190130 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb175839-504d-4d07-b576-d51202b9ccae could not be found. Aug 02 11:00:17.190130 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 11:00:17.190130 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 11:00:17.190130 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 11:00:17.190130 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:00:17.190130 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 11:00:17.190130 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 11:00:17.190130 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 11:00:17.190130 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 11:00:17.190130 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb175839-504d-4d07-b576-d51202b9ccae could not be found. Aug 02 11:00:17.190130 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 11:00:17.191307 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-11b61761-cf0f-4cb0-8a21-9777810dc76f tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Returning 404 to user: Instance eb175839-504d-4d07-b576-d51202b9ccae could not be found. {{(pid=129953) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 11:00:17.191307 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-11b61761-cf0f-4cb0-8a21-9777810dc76f tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] 10.222.0.115 "GET /compute/v2.1/servers/eb175839-504d-4d07-b576-d51202b9ccae" status: 404 len: 111 microversion: 2.1 time: 0.033038 Aug 02 11:00:17.191307 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 321/633] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:00:17 2022] GET /compute/v2.1/servers/eb175839-504d-4d07-b576-d51202b9ccae => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 11:00:17.292007 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-e377d0a7-56fc-45ad-a66e-545637c1992e tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1836167868", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1578588330", "security_groups": [{"name": "tempest-secgroup-smoke-1142860438"}], "block_device_mapping_v2": [{"uuid": "2fe55858-da4e-4587-8a7c-0a4b7855da50", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "45890e76-360d-451b-af94-f2be74c19cda"}]}} {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 11:00:17.381251 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-70fa3c2e-bf77-433e-8a5f-fc32de02a142 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:17.390013 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-70fa3c2e-bf77-433e-8a5f-fc32de02a142 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a" status: 200 len: 1734 microversion: 2.1 time: 0.270423 Aug 02 11:00:17.390588 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 313/634] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:00:17 2022] GET /compute/v2.1/servers/8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a => generated 1734 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:00:17.411542 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-d22fb0a8-fc6a-4f97-a33f-51d12e621c53 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:17.412034 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-d22fb0a8-fc6a-4f97-a33f-51d12e621c53 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:17.418441 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-d22fb0a8-fc6a-4f97-a33f-51d12e621c53 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:17.418919 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-d22fb0a8-fc6a-4f97-a33f-51d12e621c53 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:17.419752 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-d22fb0a8-fc6a-4f97-a33f-51d12e621c53 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:17.420185 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-d22fb0a8-fc6a-4f97-a33f-51d12e621c53 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:17.503266 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.network.neutron [None req-e377d0a7-56fc-45ad-a66e-545637c1992e tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] validate_networks() for [('45890e76-360d-451b-af94-f2be74c19cda', None, None, None, None, None)] {{(pid=129953) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 11:00:17.553078 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-d22fb0a8-fc6a-4f97-a33f-51d12e621c53 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.145459 Aug 02 11:00:17.553706 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 314/635] 10.222.0.115 () {58 vars in 1280 bytes} [Tue Aug 2 11:00:17 2022] GET /compute/v2.1/servers/8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a/os-interface => generated 284 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 11:00:17.993795 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.virt.hardware [None req-e377d0a7-56fc-45ad-a66e-545637c1992e tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Flavor limits 0:0:0 {{(pid=129953) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 11:00:17.994216 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.virt.hardware [None req-e377d0a7-56fc-45ad-a66e-545637c1992e tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Image limits 0:0:0 {{(pid=129953) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 11:00:17.994684 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.virt.hardware [None req-e377d0a7-56fc-45ad-a66e-545637c1992e tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Flavor pref 0:0:0 {{(pid=129953) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 11:00:17.995115 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.virt.hardware [None req-e377d0a7-56fc-45ad-a66e-545637c1992e tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Image pref 0:0:0 {{(pid=129953) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 11:00:17.995524 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.virt.hardware [None req-e377d0a7-56fc-45ad-a66e-545637c1992e tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129953) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 11:00:18.004493 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-e377d0a7-56fc-45ad-a66e-545637c1992e tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:18.004934 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-e377d0a7-56fc-45ad-a66e-545637c1992e tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:18.005758 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-e377d0a7-56fc-45ad-a66e-545637c1992e tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:18.006191 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-e377d0a7-56fc-45ad-a66e-545637c1992e tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:18.024995 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.quota [None req-e377d0a7-56fc-45ad-a66e-545637c1992e tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Getting quotas for project be66234794284419a47e3afcae968084. Resources: {'instances', 'cores', 'ram'} {{(pid=129953) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 11:00:18.029324 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.quota [None req-e377d0a7-56fc-45ad-a66e-545637c1992e tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Getting quotas for user 914de37664914b4cb91e0ce2c3a0e1d1 and project be66234794284419a47e3afcae968084. Resources: {'instances', 'cores', 'ram'} {{(pid=129953) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 11:00:18.087732 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-e377d0a7-56fc-45ad-a66e-545637c1992e tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Going to run 1 instances... {{(pid=129953) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 11:00:18.089879 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-e377d0a7-56fc-45ad-a66e-545637c1992e tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] [instance: bca2caf3-fc41-4e08-b3ac-476df1fac08b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2fe55858-da4e-4587-8a7c-0a4b7855da50',volume_size=None,volume_type=None)] {{(pid=129953) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 11:00:18.142480 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-ecf93223-f7c7-44e4-963f-5b654658417b tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:18.144910 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-ecf93223-f7c7-44e4-963f-5b654658417b tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: f86a8852-12b8-46d3-bd9b-bc140757b4c5] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:18.149924 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-ecf93223-f7c7-44e4-963f-5b654658417b tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:18.150442 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-ecf93223-f7c7-44e4-963f-5b654658417b tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:18.151238 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-ecf93223-f7c7-44e4-963f-5b654658417b tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:18.151683 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-ecf93223-f7c7-44e4-963f-5b654658417b tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:18.286208 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-ecf93223-f7c7-44e4-963f-5b654658417b tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:18.294380 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-ecf93223-f7c7-44e4-963f-5b654658417b tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:18.295932 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-ecf93223-f7c7-44e4-963f-5b654658417b tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:18.297155 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-ecf93223-f7c7-44e4-963f-5b654658417b tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5" status: 200 len: 1727 microversion: 2.20 time: 0.159110 Aug 02 11:00:18.297718 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 315/636] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 11:00:18 2022] GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5 => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 11:00:18.302213 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-6bfabec8-1dbd-4873-897e-853474db853e tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:18.302890 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-6bfabec8-1dbd-4873-897e-853474db853e tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: 07d63415-e151-4b2f-93ff-0769c401f16b] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:18.309790 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-6bfabec8-1dbd-4873-897e-853474db853e tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:18.310288 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-6bfabec8-1dbd-4873-897e-853474db853e tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:18.311322 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-6bfabec8-1dbd-4873-897e-853474db853e tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:18.311769 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-6bfabec8-1dbd-4873-897e-853474db853e tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:18.448006 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-6bfabec8-1dbd-4873-897e-853474db853e tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bc14ada1564911b2f0a698aef3f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a4a0cf1852449e8bfc59ddb5a902c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:18.456604 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-6bfabec8-1dbd-4873-897e-853474db853e tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "GET /compute/v2.1/servers/07d63415-e151-4b2f-93ff-0769c401f16b" status: 200 len: 1371 microversion: 2.1 time: 0.157704 Aug 02 11:00:18.457671 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 316/637] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:00:18 2022] GET /compute/v2.1/servers/07d63415-e151-4b2f-93ff-0769c401f16b => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:00:18.601408 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-e377d0a7-56fc-45ad-a66e-545637c1992e tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] 10.222.0.115 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.313699 Aug 02 11:00:18.603187 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 322/638] 10.222.0.115 () {60 vars in 1152 bytes} [Tue Aug 2 11:00:17 2022] POST /compute/v2.1/servers => generated 408 bytes in 1316 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 02 11:00:18.614328 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-f2f3582e-d668-464a-b732-4a5fe60c0f51 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:18.615090 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-f2f3582e-d668-464a-b732-4a5fe60c0f51 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] [instance: bca2caf3-fc41-4e08-b3ac-476df1fac08b] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:18.694525 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [req-1180d9fa-ebbf-45f1-8e30-87fa7d8fdbc6 req-ace2b150-eb33-487f-9a29-8bbd93a74767 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a", "tag": "83daf3e6-2460-4c6a-8114-303f93cdd38a"}]} {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 11:00:18.707228 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [req-1180d9fa-ebbf-45f1-8e30-87fa7d8fdbc6 req-ace2b150-eb33-487f-9a29-8bbd93a74767 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:18.708035 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-f2f3582e-d668-464a-b732-4a5fe60c0f51 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914de37664914b4cb91e0ce2c3a0e1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66234794284419a47e3afcae968084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:18.708358 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [req-1180d9fa-ebbf-45f1-8e30-87fa7d8fdbc6 req-ace2b150-eb33-487f-9a29-8bbd93a74767 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:18.716225 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-f2f3582e-d668-464a-b732-4a5fe60c0f51 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] 10.222.0.115 "GET /compute/v2.1/servers/bca2caf3-fc41-4e08-b3ac-476df1fac08b" status: 200 len: 1098 microversion: 2.1 time: 0.105781 Aug 02 11:00:18.716812 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 317/639] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:00:18 2022] GET /compute/v2.1/servers/bca2caf3-fc41-4e08-b3ac-476df1fac08b => generated 1098 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:00:18.732575 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.compute.server_external_events [req-1180d9fa-ebbf-45f1-8e30-87fa7d8fdbc6 req-ace2b150-eb33-487f-9a29-8bbd93a74767 service nova] Creating event network-changed:83daf3e6-2460-4c6a-8114-303f93cdd38a for instance 8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a on hv-cinder-85031 Aug 02 11:00:18.739242 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [req-1180d9fa-ebbf-45f1-8e30-87fa7d8fdbc6 req-ace2b150-eb33-487f-9a29-8bbd93a74767 service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049002 Aug 02 11:00:18.740271 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 323/640] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Aug 2 11:00:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 11:00:19.321164 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-0db2c0c5-d644-4a9f-baab-a47987c462f3 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:19.321904 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-0db2c0c5-d644-4a9f-baab-a47987c462f3 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: f86a8852-12b8-46d3-bd9b-bc140757b4c5] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:19.329460 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-0db2c0c5-d644-4a9f-baab-a47987c462f3 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:19.330124 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-0db2c0c5-d644-4a9f-baab-a47987c462f3 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:19.330919 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-0db2c0c5-d644-4a9f-baab-a47987c462f3 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:19.331555 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-0db2c0c5-d644-4a9f-baab-a47987c462f3 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:19.479068 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-cfc82415-41ac-42fc-9f0e-00185fb5bc4b tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:19.480026 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-cfc82415-41ac-42fc-9f0e-00185fb5bc4b tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: 07d63415-e151-4b2f-93ff-0769c401f16b] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:19.505529 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-cfc82415-41ac-42fc-9f0e-00185fb5bc4b tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:19.506004 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-cfc82415-41ac-42fc-9f0e-00185fb5bc4b tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:19.508492 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-cfc82415-41ac-42fc-9f0e-00185fb5bc4b tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:19.509141 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-cfc82415-41ac-42fc-9f0e-00185fb5bc4b tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:19.529530 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-0db2c0c5-d644-4a9f-baab-a47987c462f3 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:19.540602 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-0db2c0c5-d644-4a9f-baab-a47987c462f3 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:19.542350 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-0db2c0c5-d644-4a9f-baab-a47987c462f3 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:19.543699 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-0db2c0c5-d644-4a9f-baab-a47987c462f3 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5" status: 200 len: 1727 microversion: 2.20 time: 0.226544 Aug 02 11:00:19.556973 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 318/641] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 11:00:19 2022] GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5 => generated 1727 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 11:00:19.731524 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-cfc82415-41ac-42fc-9f0e-00185fb5bc4b tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bc14ada1564911b2f0a698aef3f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a4a0cf1852449e8bfc59ddb5a902c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:19.737859 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-428f2368-dfb4-418f-a4c3-59fca953a8b9 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:19.741670 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-428f2368-dfb4-418f-a4c3-59fca953a8b9 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] [instance: bca2caf3-fc41-4e08-b3ac-476df1fac08b] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:19.746760 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-cfc82415-41ac-42fc-9f0e-00185fb5bc4b tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "GET /compute/v2.1/servers/07d63415-e151-4b2f-93ff-0769c401f16b" status: 200 len: 1371 microversion: 2.1 time: 0.272524 Aug 02 11:00:19.747930 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 324/642] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:00:19 2022] GET /compute/v2.1/servers/07d63415-e151-4b2f-93ff-0769c401f16b => generated 1371 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 11:00:19.748139 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-428f2368-dfb4-418f-a4c3-59fca953a8b9 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:19.748767 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-428f2368-dfb4-418f-a4c3-59fca953a8b9 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:19.749735 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-428f2368-dfb4-418f-a4c3-59fca953a8b9 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:19.750184 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-428f2368-dfb4-418f-a4c3-59fca953a8b9 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:19.852832 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-428f2368-dfb4-418f-a4c3-59fca953a8b9 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914de37664914b4cb91e0ce2c3a0e1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66234794284419a47e3afcae968084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:19.860762 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-428f2368-dfb4-418f-a4c3-59fca953a8b9 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] 10.222.0.115 "GET /compute/v2.1/servers/bca2caf3-fc41-4e08-b3ac-476df1fac08b" status: 200 len: 1148 microversion: 2.1 time: 0.126843 Aug 02 11:00:19.861327 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 319/643] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:00:19 2022] GET /compute/v2.1/servers/bca2caf3-fc41-4e08-b3ac-476df1fac08b => generated 1148 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 11:00:20.568290 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-dbcfae0d-426a-4752-bfc4-d23f21833f5b tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:20.568899 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-dbcfae0d-426a-4752-bfc4-d23f21833f5b tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: f86a8852-12b8-46d3-bd9b-bc140757b4c5] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:20.575718 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-dbcfae0d-426a-4752-bfc4-d23f21833f5b tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:20.576167 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-dbcfae0d-426a-4752-bfc4-d23f21833f5b tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:20.576991 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-dbcfae0d-426a-4752-bfc4-d23f21833f5b tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:20.577420 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-dbcfae0d-426a-4752-bfc4-d23f21833f5b tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:20.710719 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-dbcfae0d-426a-4752-bfc4-d23f21833f5b tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:20.714967 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG dbcounter [-] [129953] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 11:00:20.720018 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-dbcfae0d-426a-4752-bfc4-d23f21833f5b tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:20.721555 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-dbcfae0d-426a-4752-bfc4-d23f21833f5b tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:20.722733 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-dbcfae0d-426a-4752-bfc4-d23f21833f5b tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5" status: 200 len: 1727 microversion: 2.20 time: 0.158530 Aug 02 11:00:20.723317 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 325/644] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 11:00:20 2022] GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5 => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 11:00:20.754221 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [req-8fbfdd73-a0f2-4a53-813d-d0743087c32b req-016b7481-3543-4165-9f43-2c31e4c01448 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a", "tag": "83daf3e6-2460-4c6a-8114-303f93cdd38a"}]} {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 11:00:20.765499 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [req-8fbfdd73-a0f2-4a53-813d-d0743087c32b req-016b7481-3543-4165-9f43-2c31e4c01448 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:20.765940 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [req-8fbfdd73-a0f2-4a53-813d-d0743087c32b req-016b7481-3543-4165-9f43-2c31e4c01448 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:20.768928 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-b5b30669-87ec-42b5-9efe-dfee442be467 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:20.770180 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-b5b30669-87ec-42b5-9efe-dfee442be467 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: 07d63415-e151-4b2f-93ff-0769c401f16b] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:20.777746 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-b5b30669-87ec-42b5-9efe-dfee442be467 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:20.778440 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-b5b30669-87ec-42b5-9efe-dfee442be467 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:20.778724 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.compute.server_external_events [req-8fbfdd73-a0f2-4a53-813d-d0743087c32b req-016b7481-3543-4165-9f43-2c31e4c01448 service nova] Creating event network-changed:83daf3e6-2460-4c6a-8114-303f93cdd38a for instance 8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a on hv-cinder-85031 Aug 02 11:00:20.779285 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-b5b30669-87ec-42b5-9efe-dfee442be467 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:20.779731 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-b5b30669-87ec-42b5-9efe-dfee442be467 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:20.784804 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [req-8fbfdd73-a0f2-4a53-813d-d0743087c32b req-016b7481-3543-4165-9f43-2c31e4c01448 service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033515 Aug 02 11:00:20.784804 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 320/645] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Aug 2 11:00:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 11:00:20.882483 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-b2129a2f-54dd-4c30-a0f6-b6ad048f470e tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:20.883709 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-b2129a2f-54dd-4c30-a0f6-b6ad048f470e tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] [instance: bca2caf3-fc41-4e08-b3ac-476df1fac08b] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:20.914933 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-b2129a2f-54dd-4c30-a0f6-b6ad048f470e tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:20.915409 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-b2129a2f-54dd-4c30-a0f6-b6ad048f470e tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:20.916306 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-b2129a2f-54dd-4c30-a0f6-b6ad048f470e tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:20.916647 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-b2129a2f-54dd-4c30-a0f6-b6ad048f470e tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:21.010127 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-b2129a2f-54dd-4c30-a0f6-b6ad048f470e tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914de37664914b4cb91e0ce2c3a0e1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66234794284419a47e3afcae968084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:21.015155 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG dbcounter [-] [129952] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 11:00:21.032941 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-b2129a2f-54dd-4c30-a0f6-b6ad048f470e tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] 10.222.0.115 "GET /compute/v2.1/servers/bca2caf3-fc41-4e08-b3ac-476df1fac08b" status: 200 len: 1204 microversion: 2.1 time: 0.151575 Aug 02 11:00:21.045688 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 321/646] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:00:20 2022] GET /compute/v2.1/servers/bca2caf3-fc41-4e08-b3ac-476df1fac08b => generated 1204 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 11:00:21.051589 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-b5b30669-87ec-42b5-9efe-dfee442be467 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bc14ada1564911b2f0a698aef3f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a4a0cf1852449e8bfc59ddb5a902c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:21.059921 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-b5b30669-87ec-42b5-9efe-dfee442be467 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "GET /compute/v2.1/servers/07d63415-e151-4b2f-93ff-0769c401f16b" status: 200 len: 1371 microversion: 2.1 time: 0.294881 Aug 02 11:00:21.060506 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 326/647] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:00:20 2022] GET /compute/v2.1/servers/07d63415-e151-4b2f-93ff-0769c401f16b => generated 1371 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 11:00:21.746327 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-6db81574-52ff-4baf-94b5-2fb00b614781 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:21.747317 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-6db81574-52ff-4baf-94b5-2fb00b614781 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: f86a8852-12b8-46d3-bd9b-bc140757b4c5] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:21.754999 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-6db81574-52ff-4baf-94b5-2fb00b614781 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:21.756210 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-6db81574-52ff-4baf-94b5-2fb00b614781 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:21.757418 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-6db81574-52ff-4baf-94b5-2fb00b614781 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:21.758353 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-6db81574-52ff-4baf-94b5-2fb00b614781 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:21.928445 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-6db81574-52ff-4baf-94b5-2fb00b614781 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:21.939020 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-6db81574-52ff-4baf-94b5-2fb00b614781 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:21.940593 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-6db81574-52ff-4baf-94b5-2fb00b614781 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:21.941852 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-6db81574-52ff-4baf-94b5-2fb00b614781 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5" status: 200 len: 1727 microversion: 2.20 time: 0.199878 Aug 02 11:00:21.942862 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 322/648] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 11:00:21 2022] GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5 => generated 1727 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 11:00:22.059209 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-7246649d-daca-462d-92df-b1307a6f1e19 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:22.060224 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-7246649d-daca-462d-92df-b1307a6f1e19 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] [instance: bca2caf3-fc41-4e08-b3ac-476df1fac08b] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:22.067541 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-7246649d-daca-462d-92df-b1307a6f1e19 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:22.068369 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-7246649d-daca-462d-92df-b1307a6f1e19 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:22.069267 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-7246649d-daca-462d-92df-b1307a6f1e19 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:22.069783 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-7246649d-daca-462d-92df-b1307a6f1e19 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:22.083595 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-53a94b85-0e55-4cc4-a0bc-e58e512b65ee tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:22.086102 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-53a94b85-0e55-4cc4-a0bc-e58e512b65ee tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: 07d63415-e151-4b2f-93ff-0769c401f16b] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:22.092274 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-53a94b85-0e55-4cc4-a0bc-e58e512b65ee tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:22.092727 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-53a94b85-0e55-4cc4-a0bc-e58e512b65ee tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:22.093512 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-53a94b85-0e55-4cc4-a0bc-e58e512b65ee tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:22.093951 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-53a94b85-0e55-4cc4-a0bc-e58e512b65ee tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:22.329402 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-7246649d-daca-462d-92df-b1307a6f1e19 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914de37664914b4cb91e0ce2c3a0e1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66234794284419a47e3afcae968084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:22.335772 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-53a94b85-0e55-4cc4-a0bc-e58e512b65ee tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bc14ada1564911b2f0a698aef3f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a4a0cf1852449e8bfc59ddb5a902c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:22.338490 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-7246649d-daca-462d-92df-b1307a6f1e19 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] 10.222.0.115 "GET /compute/v2.1/servers/bca2caf3-fc41-4e08-b3ac-476df1fac08b" status: 200 len: 1282 microversion: 2.1 time: 0.284132 Aug 02 11:00:22.341080 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 327/649] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:00:22 2022] GET /compute/v2.1/servers/bca2caf3-fc41-4e08-b3ac-476df1fac08b => generated 1282 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:00:22.356493 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-53a94b85-0e55-4cc4-a0bc-e58e512b65ee tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "GET /compute/v2.1/servers/07d63415-e151-4b2f-93ff-0769c401f16b" status: 200 len: 1371 microversion: 2.1 time: 0.278313 Aug 02 11:00:22.357094 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 323/650] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:00:22 2022] GET /compute/v2.1/servers/07d63415-e151-4b2f-93ff-0769c401f16b => generated 1371 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 11:00:22.966215 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-e07dc7dc-ad14-41a0-acd3-7c147c865bc2 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:22.966844 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-e07dc7dc-ad14-41a0-acd3-7c147c865bc2 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: f86a8852-12b8-46d3-bd9b-bc140757b4c5] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:22.969261 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [req-3ecc2b2e-3a1b-40d5-9861-f1658d019e06 req-34e75f75-8948-41f5-8b3e-2d3e7f5bf33a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bca2caf3-fc41-4e08-b3ac-476df1fac08b", "tag": "3c75c1d1-beb4-4085-beda-a9f460b8bf87"}]} {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 11:00:22.980651 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-e07dc7dc-ad14-41a0-acd3-7c147c865bc2 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:22.980902 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [req-3ecc2b2e-3a1b-40d5-9861-f1658d019e06 req-34e75f75-8948-41f5-8b3e-2d3e7f5bf33a service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:22.981346 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [req-3ecc2b2e-3a1b-40d5-9861-f1658d019e06 req-34e75f75-8948-41f5-8b3e-2d3e7f5bf33a service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:22.981517 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-e07dc7dc-ad14-41a0-acd3-7c147c865bc2 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:22.982237 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-e07dc7dc-ad14-41a0-acd3-7c147c865bc2 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:22.982877 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-e07dc7dc-ad14-41a0-acd3-7c147c865bc2 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:22.994278 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.compute.server_external_events [req-3ecc2b2e-3a1b-40d5-9861-f1658d019e06 req-34e75f75-8948-41f5-8b3e-2d3e7f5bf33a service nova] Creating event network-changed:3c75c1d1-beb4-4085-beda-a9f460b8bf87 for instance bca2caf3-fc41-4e08-b3ac-476df1fac08b on hv-cinder-85031 Aug 02 11:00:22.999167 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [req-3ecc2b2e-3a1b-40d5-9861-f1658d019e06 req-34e75f75-8948-41f5-8b3e-2d3e7f5bf33a service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033685 Aug 02 11:00:23.000117 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 324/651] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Aug 2 11:00:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 11:00:23.121570 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-e07dc7dc-ad14-41a0-acd3-7c147c865bc2 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:23.129898 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-e07dc7dc-ad14-41a0-acd3-7c147c865bc2 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:23.131349 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-e07dc7dc-ad14-41a0-acd3-7c147c865bc2 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:23.132505 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-e07dc7dc-ad14-41a0-acd3-7c147c865bc2 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5" status: 200 len: 1727 microversion: 2.20 time: 0.170526 Aug 02 11:00:23.133281 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 328/652] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 11:00:22 2022] GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5 => generated 1727 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 11:00:23.361146 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-1e61d4ba-f4c0-4e32-b9d6-9d4b12bfeefa tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:23.361959 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-1e61d4ba-f4c0-4e32-b9d6-9d4b12bfeefa tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] [instance: bca2caf3-fc41-4e08-b3ac-476df1fac08b] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:23.368571 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-1e61d4ba-f4c0-4e32-b9d6-9d4b12bfeefa tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:23.373885 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-1e61d4ba-f4c0-4e32-b9d6-9d4b12bfeefa tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:23.373885 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-1e61d4ba-f4c0-4e32-b9d6-9d4b12bfeefa tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:23.373885 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-1e61d4ba-f4c0-4e32-b9d6-9d4b12bfeefa tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:23.386417 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-0fdeafa1-7cc5-455a-b4a8-2d69fbe074a3 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:23.387250 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-0fdeafa1-7cc5-455a-b4a8-2d69fbe074a3 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: 07d63415-e151-4b2f-93ff-0769c401f16b] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:23.393593 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-0fdeafa1-7cc5-455a-b4a8-2d69fbe074a3 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:23.394288 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-0fdeafa1-7cc5-455a-b4a8-2d69fbe074a3 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:23.395357 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-0fdeafa1-7cc5-455a-b4a8-2d69fbe074a3 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:23.395892 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-0fdeafa1-7cc5-455a-b4a8-2d69fbe074a3 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:23.580275 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-1e61d4ba-f4c0-4e32-b9d6-9d4b12bfeefa tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914de37664914b4cb91e0ce2c3a0e1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66234794284419a47e3afcae968084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:23.589290 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-0fdeafa1-7cc5-455a-b4a8-2d69fbe074a3 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bc14ada1564911b2f0a698aef3f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a4a0cf1852449e8bfc59ddb5a902c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:23.590773 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-1e61d4ba-f4c0-4e32-b9d6-9d4b12bfeefa tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] 10.222.0.115 "GET /compute/v2.1/servers/bca2caf3-fc41-4e08-b3ac-476df1fac08b" status: 200 len: 1270 microversion: 2.1 time: 0.233876 Aug 02 11:00:23.591496 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 325/653] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:00:23 2022] GET /compute/v2.1/servers/bca2caf3-fc41-4e08-b3ac-476df1fac08b => generated 1270 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:00:23.597139 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-0fdeafa1-7cc5-455a-b4a8-2d69fbe074a3 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "GET /compute/v2.1/servers/07d63415-e151-4b2f-93ff-0769c401f16b" status: 200 len: 1371 microversion: 2.1 time: 0.214855 Aug 02 11:00:23.610832 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 329/654] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:00:23 2022] GET /compute/v2.1/servers/07d63415-e151-4b2f-93ff-0769c401f16b => generated 1371 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 11:00:24.025479 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [req-9a1ea855-e8b6-4cca-9010-94c9e6ca7c9e req-eea0db7a-f2cf-4c48-a68a-b034b5ee9dc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07d63415-e151-4b2f-93ff-0769c401f16b", "name": "network-vif-plugged", "status": "completed", "tag": "4e1594b0-146d-4aca-806b-5d9b5a8ab2c1"}]} {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 11:00:24.036286 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [req-9a1ea855-e8b6-4cca-9010-94c9e6ca7c9e req-eea0db7a-f2cf-4c48-a68a-b034b5ee9dc6 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:24.036737 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [req-9a1ea855-e8b6-4cca-9010-94c9e6ca7c9e req-eea0db7a-f2cf-4c48-a68a-b034b5ee9dc6 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:24.048052 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.compute.server_external_events [req-9a1ea855-e8b6-4cca-9010-94c9e6ca7c9e req-eea0db7a-f2cf-4c48-a68a-b034b5ee9dc6 service nova] Creating event network-vif-plugged:4e1594b0-146d-4aca-806b-5d9b5a8ab2c1 for instance 07d63415-e151-4b2f-93ff-0769c401f16b on hv-cinder-85031 Aug 02 11:00:24.052953 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [req-9a1ea855-e8b6-4cca-9010-94c9e6ca7c9e req-eea0db7a-f2cf-4c48-a68a-b034b5ee9dc6 service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032466 Aug 02 11:00:24.053546 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 326/655] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Aug 2 11:00:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 11:00:24.156317 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-f2948637-4fb1-4a9a-b0e5-3a6e8ba47d53 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:24.157233 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-f2948637-4fb1-4a9a-b0e5-3a6e8ba47d53 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: f86a8852-12b8-46d3-bd9b-bc140757b4c5] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:24.165882 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-f2948637-4fb1-4a9a-b0e5-3a6e8ba47d53 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:24.166246 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-f2948637-4fb1-4a9a-b0e5-3a6e8ba47d53 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:24.167143 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-f2948637-4fb1-4a9a-b0e5-3a6e8ba47d53 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:24.167597 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-f2948637-4fb1-4a9a-b0e5-3a6e8ba47d53 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:24.312818 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-f2948637-4fb1-4a9a-b0e5-3a6e8ba47d53 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:24.321606 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-f2948637-4fb1-4a9a-b0e5-3a6e8ba47d53 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:24.323168 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-f2948637-4fb1-4a9a-b0e5-3a6e8ba47d53 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:24.324345 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-f2948637-4fb1-4a9a-b0e5-3a6e8ba47d53 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5" status: 200 len: 1727 microversion: 2.20 time: 0.172434 Aug 02 11:00:24.324899 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 330/656] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 11:00:24 2022] GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5 => generated 1727 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 11:00:24.613308 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-22048b10-885c-47a7-a9bd-eea9f620f271 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:24.614125 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-22048b10-885c-47a7-a9bd-eea9f620f271 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] [instance: bca2caf3-fc41-4e08-b3ac-476df1fac08b] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:24.618149 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-6ab5a9a4-78ab-4b3d-a26e-6130c580f6a0 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:24.618794 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-6ab5a9a4-78ab-4b3d-a26e-6130c580f6a0 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: 07d63415-e151-4b2f-93ff-0769c401f16b] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:24.621218 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-22048b10-885c-47a7-a9bd-eea9f620f271 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:24.621672 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-22048b10-885c-47a7-a9bd-eea9f620f271 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:24.622471 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-22048b10-885c-47a7-a9bd-eea9f620f271 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:24.622906 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-22048b10-885c-47a7-a9bd-eea9f620f271 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:24.625029 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-6ab5a9a4-78ab-4b3d-a26e-6130c580f6a0 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:24.625500 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-6ab5a9a4-78ab-4b3d-a26e-6130c580f6a0 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:24.626272 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-6ab5a9a4-78ab-4b3d-a26e-6130c580f6a0 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:24.626711 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-6ab5a9a4-78ab-4b3d-a26e-6130c580f6a0 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:24.854409 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-22048b10-885c-47a7-a9bd-eea9f620f271 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914de37664914b4cb91e0ce2c3a0e1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66234794284419a47e3afcae968084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:24.854598 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-6ab5a9a4-78ab-4b3d-a26e-6130c580f6a0 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bc14ada1564911b2f0a698aef3f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a4a0cf1852449e8bfc59ddb5a902c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:24.854726 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-22048b10-885c-47a7-a9bd-eea9f620f271 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] 10.222.0.115 "GET /compute/v2.1/servers/bca2caf3-fc41-4e08-b3ac-476df1fac08b" status: 200 len: 1270 microversion: 2.1 time: 0.242354 Aug 02 11:00:24.854726 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 327/657] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:00:24 2022] GET /compute/v2.1/servers/bca2caf3-fc41-4e08-b3ac-476df1fac08b => generated 1270 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:00:24.855366 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-6ab5a9a4-78ab-4b3d-a26e-6130c580f6a0 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "GET /compute/v2.1/servers/07d63415-e151-4b2f-93ff-0769c401f16b" status: 200 len: 1371 microversion: 2.1 time: 0.241582 Aug 02 11:00:24.855938 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 331/658] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:00:24 2022] GET /compute/v2.1/servers/07d63415-e151-4b2f-93ff-0769c401f16b => generated 1371 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 11:00:25.347470 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-671fa4b6-0b20-4afd-974e-b4d87338b84a tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:25.348104 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-671fa4b6-0b20-4afd-974e-b4d87338b84a tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: f86a8852-12b8-46d3-bd9b-bc140757b4c5] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:25.355407 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-671fa4b6-0b20-4afd-974e-b4d87338b84a tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:25.355868 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-671fa4b6-0b20-4afd-974e-b4d87338b84a tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:25.356647 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-671fa4b6-0b20-4afd-974e-b4d87338b84a tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:25.357088 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-671fa4b6-0b20-4afd-974e-b4d87338b84a tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:25.495914 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-671fa4b6-0b20-4afd-974e-b4d87338b84a tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:25.503933 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-671fa4b6-0b20-4afd-974e-b4d87338b84a tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:25.505475 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-671fa4b6-0b20-4afd-974e-b4d87338b84a tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:25.506632 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-671fa4b6-0b20-4afd-974e-b4d87338b84a tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5" status: 200 len: 1727 microversion: 2.20 time: 0.163178 Aug 02 11:00:25.507221 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 328/659] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 11:00:25 2022] GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5 => generated 1727 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 11:00:25.874411 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-1652f123-776c-43a9-97be-075cca0bfe3e tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:25.875031 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-1652f123-776c-43a9-97be-075cca0bfe3e tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] [instance: bca2caf3-fc41-4e08-b3ac-476df1fac08b] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:25.876010 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-52a2d1ac-65bc-4065-81aa-e1b95ccaf00d tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:25.876624 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-52a2d1ac-65bc-4065-81aa-e1b95ccaf00d tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: 07d63415-e151-4b2f-93ff-0769c401f16b] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:25.881703 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-1652f123-776c-43a9-97be-075cca0bfe3e tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:25.882152 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-1652f123-776c-43a9-97be-075cca0bfe3e tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:25.883438 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-52a2d1ac-65bc-4065-81aa-e1b95ccaf00d tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:25.883565 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-1652f123-776c-43a9-97be-075cca0bfe3e tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:25.883890 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-52a2d1ac-65bc-4065-81aa-e1b95ccaf00d tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:25.884102 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-1652f123-776c-43a9-97be-075cca0bfe3e tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:25.884655 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-52a2d1ac-65bc-4065-81aa-e1b95ccaf00d tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:25.885091 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-52a2d1ac-65bc-4065-81aa-e1b95ccaf00d tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:26.081800 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-1652f123-776c-43a9-97be-075cca0bfe3e tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914de37664914b4cb91e0ce2c3a0e1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66234794284419a47e3afcae968084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:26.086152 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-52a2d1ac-65bc-4065-81aa-e1b95ccaf00d tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bc14ada1564911b2f0a698aef3f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a4a0cf1852449e8bfc59ddb5a902c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:26.090200 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-1652f123-776c-43a9-97be-075cca0bfe3e tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] 10.222.0.115 "GET /compute/v2.1/servers/bca2caf3-fc41-4e08-b3ac-476df1fac08b" status: 200 len: 1270 microversion: 2.1 time: 0.219668 Aug 02 11:00:26.090779 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 332/660] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:00:25 2022] GET /compute/v2.1/servers/bca2caf3-fc41-4e08-b3ac-476df1fac08b => generated 1270 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:00:26.094008 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-52a2d1ac-65bc-4065-81aa-e1b95ccaf00d tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "GET /compute/v2.1/servers/07d63415-e151-4b2f-93ff-0769c401f16b" status: 200 len: 1371 microversion: 2.1 time: 0.221850 Aug 02 11:00:26.094648 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 329/661] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:00:25 2022] GET /compute/v2.1/servers/07d63415-e151-4b2f-93ff-0769c401f16b => generated 1371 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 11:00:26.530969 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-2326e4ee-3860-4678-8888-7ca803e85722 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:26.531637 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-2326e4ee-3860-4678-8888-7ca803e85722 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: f86a8852-12b8-46d3-bd9b-bc140757b4c5] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:26.537662 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-2326e4ee-3860-4678-8888-7ca803e85722 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:26.538108 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-2326e4ee-3860-4678-8888-7ca803e85722 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:26.538941 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-2326e4ee-3860-4678-8888-7ca803e85722 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:26.539449 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-2326e4ee-3860-4678-8888-7ca803e85722 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:26.670914 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-2326e4ee-3860-4678-8888-7ca803e85722 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:26.678775 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-2326e4ee-3860-4678-8888-7ca803e85722 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:26.680758 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-2326e4ee-3860-4678-8888-7ca803e85722 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:26.681805 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-2326e4ee-3860-4678-8888-7ca803e85722 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5" status: 200 len: 1727 microversion: 2.20 time: 0.155064 Aug 02 11:00:26.682356 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 333/662] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 11:00:26 2022] GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 11:00:27.112268 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-915b187b-8898-46fb-9572-092446f619d2 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:27.112891 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-915b187b-8898-46fb-9572-092446f619d2 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] [instance: bca2caf3-fc41-4e08-b3ac-476df1fac08b] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:27.116507 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-0eb54ed8-7459-462d-92c0-8377a8246f6f tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:27.116934 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-0eb54ed8-7459-462d-92c0-8377a8246f6f tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: 07d63415-e151-4b2f-93ff-0769c401f16b] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:27.119674 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-915b187b-8898-46fb-9572-092446f619d2 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:27.120128 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-915b187b-8898-46fb-9572-092446f619d2 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:27.120902 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-915b187b-8898-46fb-9572-092446f619d2 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:27.121334 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-915b187b-8898-46fb-9572-092446f619d2 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:27.123851 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-0eb54ed8-7459-462d-92c0-8377a8246f6f tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:27.124301 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-0eb54ed8-7459-462d-92c0-8377a8246f6f tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:27.125102 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-0eb54ed8-7459-462d-92c0-8377a8246f6f tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:27.125535 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-0eb54ed8-7459-462d-92c0-8377a8246f6f tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:27.321134 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-915b187b-8898-46fb-9572-092446f619d2 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914de37664914b4cb91e0ce2c3a0e1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66234794284419a47e3afcae968084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:27.324509 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-0eb54ed8-7459-462d-92c0-8377a8246f6f tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bc14ada1564911b2f0a698aef3f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a4a0cf1852449e8bfc59ddb5a902c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:27.329159 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-915b187b-8898-46fb-9572-092446f619d2 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] 10.222.0.115 "GET /compute/v2.1/servers/bca2caf3-fc41-4e08-b3ac-476df1fac08b" status: 200 len: 1270 microversion: 2.1 time: 0.220808 Aug 02 11:00:27.329735 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 330/663] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:00:27 2022] GET /compute/v2.1/servers/bca2caf3-fc41-4e08-b3ac-476df1fac08b => generated 1270 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:00:27.332024 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-0eb54ed8-7459-462d-92c0-8377a8246f6f tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "GET /compute/v2.1/servers/07d63415-e151-4b2f-93ff-0769c401f16b" status: 200 len: 1562 microversion: 2.1 time: 0.219699 Aug 02 11:00:27.332581 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 334/664] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:00:27 2022] GET /compute/v2.1/servers/07d63415-e151-4b2f-93ff-0769c401f16b => generated 1562 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 11:00:27.353055 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-64f89652-c6f7-4d97-a2d2-25a22ae7aae1 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:27.353783 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-64f89652-c6f7-4d97-a2d2-25a22ae7aae1 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: 07d63415-e151-4b2f-93ff-0769c401f16b] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:27.359726 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-64f89652-c6f7-4d97-a2d2-25a22ae7aae1 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:27.360167 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-64f89652-c6f7-4d97-a2d2-25a22ae7aae1 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:27.360919 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-64f89652-c6f7-4d97-a2d2-25a22ae7aae1 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:27.361348 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-64f89652-c6f7-4d97-a2d2-25a22ae7aae1 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:27.440587 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-64f89652-c6f7-4d97-a2d2-25a22ae7aae1 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "GET /compute/v2.1/servers/07d63415-e151-4b2f-93ff-0769c401f16b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091939 Aug 02 11:00:27.446014 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 331/665] 10.222.0.115 () {58 vars in 1280 bytes} [Tue Aug 2 11:00:27 2022] GET /compute/v2.1/servers/07d63415-e151-4b2f-93ff-0769c401f16b/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 11:00:27.704910 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-27715cc5-ef5b-480b-bab8-5c07b7116736 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:27.705507 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-27715cc5-ef5b-480b-bab8-5c07b7116736 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: f86a8852-12b8-46d3-bd9b-bc140757b4c5] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:27.711427 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-27715cc5-ef5b-480b-bab8-5c07b7116736 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:27.711935 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-27715cc5-ef5b-480b-bab8-5c07b7116736 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:27.712801 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-27715cc5-ef5b-480b-bab8-5c07b7116736 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:27.713390 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-27715cc5-ef5b-480b-bab8-5c07b7116736 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:27.953530 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-27715cc5-ef5b-480b-bab8-5c07b7116736 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:27.962122 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-27715cc5-ef5b-480b-bab8-5c07b7116736 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:27.963704 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-27715cc5-ef5b-480b-bab8-5c07b7116736 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:27.964862 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-27715cc5-ef5b-480b-bab8-5c07b7116736 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5" status: 200 len: 1748 microversion: 2.20 time: 0.263828 Aug 02 11:00:27.965413 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 335/666] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 11:00:27 2022] GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5 => generated 1748 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 11:00:28.350562 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-2d406657-f0e6-4e31-939f-ae3f4c851545 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:28.351177 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-2d406657-f0e6-4e31-939f-ae3f4c851545 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] [instance: bca2caf3-fc41-4e08-b3ac-476df1fac08b] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:28.357965 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-2d406657-f0e6-4e31-939f-ae3f4c851545 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:28.358411 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-2d406657-f0e6-4e31-939f-ae3f4c851545 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:28.359216 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-2d406657-f0e6-4e31-939f-ae3f4c851545 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:28.359653 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-2d406657-f0e6-4e31-939f-ae3f4c851545 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:28.716331 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG dbcounter [-] [129952] Writing DB stats nova_cell0:SELECT=4 {{(pid=129952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 11:00:28.831201 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-2d406657-f0e6-4e31-939f-ae3f4c851545 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914de37664914b4cb91e0ce2c3a0e1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66234794284419a47e3afcae968084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:28.839882 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG dbcounter [-] [129953] Writing DB stats nova_cell0:SELECT=4 {{(pid=129953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 11:00:28.857843 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG dbcounter [-] [129953] Writing DB stats nova_cell0:SELECT=16 {{(pid=129953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 11:00:28.858187 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-2d406657-f0e6-4e31-939f-ae3f4c851545 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] 10.222.0.115 "GET /compute/v2.1/servers/bca2caf3-fc41-4e08-b3ac-476df1fac08b" status: 200 len: 1270 microversion: 2.1 time: 0.495335 Aug 02 11:00:28.858187 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 332/667] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:00:28 2022] GET /compute/v2.1/servers/bca2caf3-fc41-4e08-b3ac-476df1fac08b => generated 1270 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:00:28.903676 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [req-cf5cc0c0-0922-405b-be2e-137a8c96ccfc req-c1f280d6-4e5f-4576-a7d2-3f959dccb301 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07d63415-e151-4b2f-93ff-0769c401f16b", "tag": "4e1594b0-146d-4aca-806b-5d9b5a8ab2c1"}]} {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 11:00:28.913703 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [req-cf5cc0c0-0922-405b-be2e-137a8c96ccfc req-c1f280d6-4e5f-4576-a7d2-3f959dccb301 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:28.914142 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [req-cf5cc0c0-0922-405b-be2e-137a8c96ccfc req-c1f280d6-4e5f-4576-a7d2-3f959dccb301 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:28.926825 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.compute.server_external_events [req-cf5cc0c0-0922-405b-be2e-137a8c96ccfc req-c1f280d6-4e5f-4576-a7d2-3f959dccb301 service nova] Creating event network-changed:4e1594b0-146d-4aca-806b-5d9b5a8ab2c1 for instance 07d63415-e151-4b2f-93ff-0769c401f16b on hv-cinder-85031 Aug 02 11:00:28.932570 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [req-cf5cc0c0-0922-405b-be2e-137a8c96ccfc req-c1f280d6-4e5f-4576-a7d2-3f959dccb301 service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097354 Aug 02 11:00:28.933237 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 336/668] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Aug 2 11:00:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 11:00:28.990724 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-7e27e96d-1d1f-4ae4-ad7e-b392f85b55c6 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:28.991942 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-7e27e96d-1d1f-4ae4-ad7e-b392f85b55c6 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: f86a8852-12b8-46d3-bd9b-bc140757b4c5] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:29.000850 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-7e27e96d-1d1f-4ae4-ad7e-b392f85b55c6 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:29.001665 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-7e27e96d-1d1f-4ae4-ad7e-b392f85b55c6 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:29.002705 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-7e27e96d-1d1f-4ae4-ad7e-b392f85b55c6 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:29.003352 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-7e27e96d-1d1f-4ae4-ad7e-b392f85b55c6 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:29.160609 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-7e27e96d-1d1f-4ae4-ad7e-b392f85b55c6 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:29.169616 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-7e27e96d-1d1f-4ae4-ad7e-b392f85b55c6 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:29.171235 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-7e27e96d-1d1f-4ae4-ad7e-b392f85b55c6 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:29.172409 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-7e27e96d-1d1f-4ae4-ad7e-b392f85b55c6 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5" status: 200 len: 1743 microversion: 2.20 time: 0.186331 Aug 02 11:00:29.172974 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 333/669] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 11:00:28 2022] GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5 => generated 1743 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 11:00:29.866447 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-73b03be3-9b87-40c1-a5f8-690df04b9f09 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:29.867431 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-73b03be3-9b87-40c1-a5f8-690df04b9f09 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] [instance: bca2caf3-fc41-4e08-b3ac-476df1fac08b] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:29.885340 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-73b03be3-9b87-40c1-a5f8-690df04b9f09 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:29.886268 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-73b03be3-9b87-40c1-a5f8-690df04b9f09 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:29.888365 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-73b03be3-9b87-40c1-a5f8-690df04b9f09 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:29.893110 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-73b03be3-9b87-40c1-a5f8-690df04b9f09 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:30.059511 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-73b03be3-9b87-40c1-a5f8-690df04b9f09 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914de37664914b4cb91e0ce2c3a0e1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66234794284419a47e3afcae968084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:30.067859 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-73b03be3-9b87-40c1-a5f8-690df04b9f09 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] 10.222.0.115 "GET /compute/v2.1/servers/bca2caf3-fc41-4e08-b3ac-476df1fac08b" status: 200 len: 1270 microversion: 2.1 time: 0.206270 Aug 02 11:00:30.069715 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 337/670] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:00:29 2022] GET /compute/v2.1/servers/bca2caf3-fc41-4e08-b3ac-476df1fac08b => generated 1270 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:00:30.197070 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-80189470-43ce-4d9f-9363-4efd9db9b72b tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:30.201682 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-80189470-43ce-4d9f-9363-4efd9db9b72b tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: f86a8852-12b8-46d3-bd9b-bc140757b4c5] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:30.208258 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-80189470-43ce-4d9f-9363-4efd9db9b72b tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:30.208736 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-80189470-43ce-4d9f-9363-4efd9db9b72b tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:30.209530 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-80189470-43ce-4d9f-9363-4efd9db9b72b tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:30.217688 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-80189470-43ce-4d9f-9363-4efd9db9b72b tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:30.448566 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-80189470-43ce-4d9f-9363-4efd9db9b72b tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:30.470314 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-80189470-43ce-4d9f-9363-4efd9db9b72b tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:30.470314 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-80189470-43ce-4d9f-9363-4efd9db9b72b tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:30.471095 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-80189470-43ce-4d9f-9363-4efd9db9b72b tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5" status: 200 len: 1743 microversion: 2.20 time: 0.278332 Aug 02 11:00:30.471815 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 334/671] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 11:00:30 2022] GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5 => generated 1743 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 11:00:31.092857 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-89064768-ad6e-416c-b533-fa5819207095 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:31.093655 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-89064768-ad6e-416c-b533-fa5819207095 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] [instance: bca2caf3-fc41-4e08-b3ac-476df1fac08b] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:31.101096 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-89064768-ad6e-416c-b533-fa5819207095 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:31.101777 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-89064768-ad6e-416c-b533-fa5819207095 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:31.103225 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-89064768-ad6e-416c-b533-fa5819207095 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:31.103980 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-89064768-ad6e-416c-b533-fa5819207095 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:31.255841 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-89064768-ad6e-416c-b533-fa5819207095 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914de37664914b4cb91e0ce2c3a0e1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66234794284419a47e3afcae968084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:31.269109 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-89064768-ad6e-416c-b533-fa5819207095 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] 10.222.0.115 "GET /compute/v2.1/servers/bca2caf3-fc41-4e08-b3ac-476df1fac08b" status: 200 len: 1270 microversion: 2.1 time: 0.182997 Aug 02 11:00:31.270439 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 338/672] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:00:31 2022] GET /compute/v2.1/servers/bca2caf3-fc41-4e08-b3ac-476df1fac08b => generated 1270 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:00:31.496092 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-bd99e3e9-3731-42ab-bc79-7eb7daccd864 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:31.496764 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-bd99e3e9-3731-42ab-bc79-7eb7daccd864 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: f86a8852-12b8-46d3-bd9b-bc140757b4c5] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:31.503563 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-bd99e3e9-3731-42ab-bc79-7eb7daccd864 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:31.504292 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-bd99e3e9-3731-42ab-bc79-7eb7daccd864 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:31.505118 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-bd99e3e9-3731-42ab-bc79-7eb7daccd864 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:31.505536 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-bd99e3e9-3731-42ab-bc79-7eb7daccd864 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:31.656739 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-bd99e3e9-3731-42ab-bc79-7eb7daccd864 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:31.668349 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-bd99e3e9-3731-42ab-bc79-7eb7daccd864 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:31.670588 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-bd99e3e9-3731-42ab-bc79-7eb7daccd864 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:31.671819 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-bd99e3e9-3731-42ab-bc79-7eb7daccd864 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5" status: 200 len: 1743 microversion: 2.20 time: 0.180602 Aug 02 11:00:31.687068 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 335/673] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 11:00:31 2022] GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5 => generated 1743 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 11:00:32.164303 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [req-1b93f91e-b289-4b34-8bfd-bf6571284a14 req-37e491be-ea43-427a-bdf2-a1ded211f975 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f86a8852-12b8-46d3-bd9b-bc140757b4c5", "name": "network-vif-plugged", "status": "completed", "tag": "b19c6f76-3eb2-428e-95c9-247e8c1ea7c5"}]} {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 11:00:32.176735 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [req-1b93f91e-b289-4b34-8bfd-bf6571284a14 req-37e491be-ea43-427a-bdf2-a1ded211f975 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:32.177622 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [req-1b93f91e-b289-4b34-8bfd-bf6571284a14 req-37e491be-ea43-427a-bdf2-a1ded211f975 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:32.190737 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.compute.server_external_events [req-1b93f91e-b289-4b34-8bfd-bf6571284a14 req-37e491be-ea43-427a-bdf2-a1ded211f975 service nova] Creating event network-vif-plugged:b19c6f76-3eb2-428e-95c9-247e8c1ea7c5 for instance f86a8852-12b8-46d3-bd9b-bc140757b4c5 on hv-cinder-85031 Aug 02 11:00:32.198558 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [req-1b93f91e-b289-4b34-8bfd-bf6571284a14 req-37e491be-ea43-427a-bdf2-a1ded211f975 service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039142 Aug 02 11:00:32.199638 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 339/674] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Aug 2 11:00:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 11:00:32.300392 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-c60e2c08-f57d-4ebf-8299-eb36607c5f10 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:32.300392 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-c60e2c08-f57d-4ebf-8299-eb36607c5f10 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] [instance: bca2caf3-fc41-4e08-b3ac-476df1fac08b] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:32.300392 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-c60e2c08-f57d-4ebf-8299-eb36607c5f10 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:32.300392 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-c60e2c08-f57d-4ebf-8299-eb36607c5f10 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:32.300863 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-c60e2c08-f57d-4ebf-8299-eb36607c5f10 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:32.300863 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-c60e2c08-f57d-4ebf-8299-eb36607c5f10 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:32.436768 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-c60e2c08-f57d-4ebf-8299-eb36607c5f10 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914de37664914b4cb91e0ce2c3a0e1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66234794284419a47e3afcae968084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:32.444381 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-c60e2c08-f57d-4ebf-8299-eb36607c5f10 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] 10.222.0.115 "GET /compute/v2.1/servers/bca2caf3-fc41-4e08-b3ac-476df1fac08b" status: 200 len: 1270 microversion: 2.1 time: 0.157825 Aug 02 11:00:32.444889 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 336/675] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:00:32 2022] GET /compute/v2.1/servers/bca2caf3-fc41-4e08-b3ac-476df1fac08b => generated 1270 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:00:32.696873 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-32f9a157-628b-4213-9fe9-d7837d3b45cc tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:32.698020 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-32f9a157-628b-4213-9fe9-d7837d3b45cc tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: f86a8852-12b8-46d3-bd9b-bc140757b4c5] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:32.704761 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-32f9a157-628b-4213-9fe9-d7837d3b45cc tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:32.705291 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-32f9a157-628b-4213-9fe9-d7837d3b45cc tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:32.709118 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-32f9a157-628b-4213-9fe9-d7837d3b45cc tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:32.709812 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-32f9a157-628b-4213-9fe9-d7837d3b45cc tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:32.873145 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-32f9a157-628b-4213-9fe9-d7837d3b45cc tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:32.881439 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-32f9a157-628b-4213-9fe9-d7837d3b45cc tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:32.883200 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-32f9a157-628b-4213-9fe9-d7837d3b45cc tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:32.884950 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-32f9a157-628b-4213-9fe9-d7837d3b45cc tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5" status: 200 len: 1743 microversion: 2.20 time: 0.192978 Aug 02 11:00:32.885542 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 340/676] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 11:00:32 2022] GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5 => generated 1743 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 11:00:33.466969 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-f10a49de-80a6-4912-8ab2-9be5a9e227a6 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:33.468194 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-f10a49de-80a6-4912-8ab2-9be5a9e227a6 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] [instance: bca2caf3-fc41-4e08-b3ac-476df1fac08b] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:33.474862 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-f10a49de-80a6-4912-8ab2-9be5a9e227a6 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:33.475578 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-f10a49de-80a6-4912-8ab2-9be5a9e227a6 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:33.476410 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-f10a49de-80a6-4912-8ab2-9be5a9e227a6 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:33.476850 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-f10a49de-80a6-4912-8ab2-9be5a9e227a6 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:33.617497 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-f10a49de-80a6-4912-8ab2-9be5a9e227a6 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914de37664914b4cb91e0ce2c3a0e1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66234794284419a47e3afcae968084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:33.625549 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-f10a49de-80a6-4912-8ab2-9be5a9e227a6 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] 10.222.0.115 "GET /compute/v2.1/servers/bca2caf3-fc41-4e08-b3ac-476df1fac08b" status: 200 len: 1270 microversion: 2.1 time: 0.163546 Aug 02 11:00:33.626333 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 337/677] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:00:33 2022] GET /compute/v2.1/servers/bca2caf3-fc41-4e08-b3ac-476df1fac08b => generated 1270 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:00:33.913167 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-0e5b12fa-f271-4af1-8aad-b992db7ea135 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:33.913167 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-0e5b12fa-f271-4af1-8aad-b992db7ea135 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: f86a8852-12b8-46d3-bd9b-bc140757b4c5] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:33.920737 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-0e5b12fa-f271-4af1-8aad-b992db7ea135 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:33.921460 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-0e5b12fa-f271-4af1-8aad-b992db7ea135 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:33.922272 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-0e5b12fa-f271-4af1-8aad-b992db7ea135 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:33.922711 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-0e5b12fa-f271-4af1-8aad-b992db7ea135 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:34.078462 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-0e5b12fa-f271-4af1-8aad-b992db7ea135 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:34.087437 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-0e5b12fa-f271-4af1-8aad-b992db7ea135 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:34.089356 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-0e5b12fa-f271-4af1-8aad-b992db7ea135 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:34.090680 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-0e5b12fa-f271-4af1-8aad-b992db7ea135 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5" status: 200 len: 1743 microversion: 2.20 time: 0.184927 Aug 02 11:00:34.106436 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 341/678] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 11:00:33 2022] GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5 => generated 1743 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 11:00:34.402172 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [req-82cbd020-bf65-45dd-b1c8-68bf04ddbaee req-597f0f11-eade-4aa6-bc63-2f0de2fb0c7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bca2caf3-fc41-4e08-b3ac-476df1fac08b", "name": "network-vif-plugged", "status": "completed", "tag": "3c75c1d1-beb4-4085-beda-a9f460b8bf87"}]} {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 11:00:34.418885 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [req-82cbd020-bf65-45dd-b1c8-68bf04ddbaee req-597f0f11-eade-4aa6-bc63-2f0de2fb0c7a service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:34.419364 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [req-82cbd020-bf65-45dd-b1c8-68bf04ddbaee req-597f0f11-eade-4aa6-bc63-2f0de2fb0c7a service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:34.448247 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.compute.server_external_events [req-82cbd020-bf65-45dd-b1c8-68bf04ddbaee req-597f0f11-eade-4aa6-bc63-2f0de2fb0c7a service nova] Creating event network-vif-plugged:3c75c1d1-beb4-4085-beda-a9f460b8bf87 for instance bca2caf3-fc41-4e08-b3ac-476df1fac08b on hv-cinder-85031 Aug 02 11:00:34.448247 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [req-82cbd020-bf65-45dd-b1c8-68bf04ddbaee req-597f0f11-eade-4aa6-bc63-2f0de2fb0c7a service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049669 Aug 02 11:00:34.449083 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 338/679] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Aug 2 11:00:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 11:00:34.649565 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-c76c8f4c-dd28-438f-8b8b-d55a8d257c7f tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:34.650509 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-c76c8f4c-dd28-438f-8b8b-d55a8d257c7f tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] [instance: bca2caf3-fc41-4e08-b3ac-476df1fac08b] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:34.657939 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-c76c8f4c-dd28-438f-8b8b-d55a8d257c7f tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:34.658667 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-c76c8f4c-dd28-438f-8b8b-d55a8d257c7f tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:34.659470 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-c76c8f4c-dd28-438f-8b8b-d55a8d257c7f tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:34.659911 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-c76c8f4c-dd28-438f-8b8b-d55a8d257c7f tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:34.811013 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-c76c8f4c-dd28-438f-8b8b-d55a8d257c7f tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914de37664914b4cb91e0ce2c3a0e1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66234794284419a47e3afcae968084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:34.819125 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-c76c8f4c-dd28-438f-8b8b-d55a8d257c7f tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] 10.222.0.115 "GET /compute/v2.1/servers/bca2caf3-fc41-4e08-b3ac-476df1fac08b" status: 200 len: 1270 microversion: 2.1 time: 0.173894 Aug 02 11:00:34.820016 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 342/680] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:00:34 2022] GET /compute/v2.1/servers/bca2caf3-fc41-4e08-b3ac-476df1fac08b => generated 1270 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:00:35.115394 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-3932a0ab-a453-4e4b-8c7e-4cc9d6e26d87 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:35.116105 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-3932a0ab-a453-4e4b-8c7e-4cc9d6e26d87 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: f86a8852-12b8-46d3-bd9b-bc140757b4c5] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:35.123713 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-3932a0ab-a453-4e4b-8c7e-4cc9d6e26d87 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:35.124163 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-3932a0ab-a453-4e4b-8c7e-4cc9d6e26d87 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:35.125156 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-3932a0ab-a453-4e4b-8c7e-4cc9d6e26d87 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:35.125766 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-3932a0ab-a453-4e4b-8c7e-4cc9d6e26d87 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:35.270898 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-3932a0ab-a453-4e4b-8c7e-4cc9d6e26d87 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:35.280929 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-3932a0ab-a453-4e4b-8c7e-4cc9d6e26d87 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:35.283186 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-3932a0ab-a453-4e4b-8c7e-4cc9d6e26d87 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:35.284321 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-3932a0ab-a453-4e4b-8c7e-4cc9d6e26d87 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5" status: 200 len: 1743 microversion: 2.20 time: 0.174133 Aug 02 11:00:35.284897 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 339/681] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 11:00:35 2022] GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5 => generated 1743 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 11:00:35.841415 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-edbeeed4-55be-4aa8-aeaa-a0cf368a9957 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:35.842042 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-edbeeed4-55be-4aa8-aeaa-a0cf368a9957 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] [instance: bca2caf3-fc41-4e08-b3ac-476df1fac08b] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:35.845694 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG dbcounter [-] [129953] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=129953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 11:00:35.849604 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-edbeeed4-55be-4aa8-aeaa-a0cf368a9957 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:35.850030 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-edbeeed4-55be-4aa8-aeaa-a0cf368a9957 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:35.850804 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-edbeeed4-55be-4aa8-aeaa-a0cf368a9957 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:35.851271 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-edbeeed4-55be-4aa8-aeaa-a0cf368a9957 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:36.003773 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-edbeeed4-55be-4aa8-aeaa-a0cf368a9957 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914de37664914b4cb91e0ce2c3a0e1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66234794284419a47e3afcae968084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:36.008038 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG dbcounter [-] [129953] Writing DB stats nova_cell1:SELECT=100 {{(pid=129953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 11:00:36.016502 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-edbeeed4-55be-4aa8-aeaa-a0cf368a9957 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] 10.222.0.115 "GET /compute/v2.1/servers/bca2caf3-fc41-4e08-b3ac-476df1fac08b" status: 200 len: 1270 microversion: 2.1 time: 0.179616 Aug 02 11:00:36.017530 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 343/682] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:00:35 2022] GET /compute/v2.1/servers/bca2caf3-fc41-4e08-b3ac-476df1fac08b => generated 1270 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:00:36.308578 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-4d978a72-3964-4366-aa1f-4ec321fcff93 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:36.309562 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-4d978a72-3964-4366-aa1f-4ec321fcff93 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: f86a8852-12b8-46d3-bd9b-bc140757b4c5] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:36.318160 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-4d978a72-3964-4366-aa1f-4ec321fcff93 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:36.318918 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-4d978a72-3964-4366-aa1f-4ec321fcff93 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:36.319820 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-4d978a72-3964-4366-aa1f-4ec321fcff93 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:36.320322 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-4d978a72-3964-4366-aa1f-4ec321fcff93 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:36.475886 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-4d978a72-3964-4366-aa1f-4ec321fcff93 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:36.480861 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG dbcounter [-] [129952] Writing DB stats nova_cell1:SELECT=100 {{(pid=129952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 11:00:36.485902 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-4d978a72-3964-4366-aa1f-4ec321fcff93 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:36.488517 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-4d978a72-3964-4366-aa1f-4ec321fcff93 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:36.489875 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-4d978a72-3964-4366-aa1f-4ec321fcff93 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5" status: 200 len: 1743 microversion: 2.20 time: 0.185938 Aug 02 11:00:36.493438 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 340/683] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 11:00:36 2022] GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5 => generated 1743 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 11:00:37.047408 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-7df19e0f-4756-4843-a26d-75bc3d74aba0 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:37.048614 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-7df19e0f-4756-4843-a26d-75bc3d74aba0 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] [instance: bca2caf3-fc41-4e08-b3ac-476df1fac08b] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:37.056000 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-7df19e0f-4756-4843-a26d-75bc3d74aba0 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:37.056662 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-7df19e0f-4756-4843-a26d-75bc3d74aba0 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:37.057604 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-7df19e0f-4756-4843-a26d-75bc3d74aba0 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:37.058198 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-7df19e0f-4756-4843-a26d-75bc3d74aba0 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:37.228782 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-7df19e0f-4756-4843-a26d-75bc3d74aba0 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914de37664914b4cb91e0ce2c3a0e1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66234794284419a47e3afcae968084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:37.236670 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-7df19e0f-4756-4843-a26d-75bc3d74aba0 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] 10.222.0.115 "GET /compute/v2.1/servers/bca2caf3-fc41-4e08-b3ac-476df1fac08b" status: 200 len: 1457 microversion: 2.1 time: 0.196175 Aug 02 11:00:37.237254 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 344/684] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:00:37 2022] GET /compute/v2.1/servers/bca2caf3-fc41-4e08-b3ac-476df1fac08b => generated 1457 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:00:37.257463 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-e8fe4c65-f403-41a9-9842-c3ab94a484a4 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:37.258080 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-e8fe4c65-f403-41a9-9842-c3ab94a484a4 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] [instance: bca2caf3-fc41-4e08-b3ac-476df1fac08b] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:37.264910 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-e8fe4c65-f403-41a9-9842-c3ab94a484a4 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:37.265357 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-e8fe4c65-f403-41a9-9842-c3ab94a484a4 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:37.266134 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-e8fe4c65-f403-41a9-9842-c3ab94a484a4 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:37.266567 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-e8fe4c65-f403-41a9-9842-c3ab94a484a4 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:37.420308 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-e8fe4c65-f403-41a9-9842-c3ab94a484a4 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914de37664914b4cb91e0ce2c3a0e1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66234794284419a47e3afcae968084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:37.429894 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-e8fe4c65-f403-41a9-9842-c3ab94a484a4 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] 10.222.0.115 "GET /compute/v2.1/servers/bca2caf3-fc41-4e08-b3ac-476df1fac08b" status: 200 len: 1457 microversion: 2.1 time: 0.176102 Aug 02 11:00:37.432469 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 341/685] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:00:37 2022] GET /compute/v2.1/servers/bca2caf3-fc41-4e08-b3ac-476df1fac08b => generated 1457 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:00:37.516264 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-52884ff0-6928-422a-bde3-3609802dc473 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:37.517287 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-52884ff0-6928-422a-bde3-3609802dc473 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: f86a8852-12b8-46d3-bd9b-bc140757b4c5] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:37.525373 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-52884ff0-6928-422a-bde3-3609802dc473 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:37.525823 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-52884ff0-6928-422a-bde3-3609802dc473 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:37.526596 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-52884ff0-6928-422a-bde3-3609802dc473 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:37.527031 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-52884ff0-6928-422a-bde3-3609802dc473 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:37.721056 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-52884ff0-6928-422a-bde3-3609802dc473 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:37.731486 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-52884ff0-6928-422a-bde3-3609802dc473 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:37.734425 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-52884ff0-6928-422a-bde3-3609802dc473 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:37.735754 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-52884ff0-6928-422a-bde3-3609802dc473 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5" status: 200 len: 1743 microversion: 2.20 time: 0.224867 Aug 02 11:00:37.748352 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 345/686] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 11:00:37 2022] GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5 => generated 1743 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 11:00:38.761329 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-df9b52df-cf6c-4f81-83c9-be444b539a7f tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:38.762006 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-df9b52df-cf6c-4f81-83c9-be444b539a7f tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: f86a8852-12b8-46d3-bd9b-bc140757b4c5] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:38.769352 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-df9b52df-cf6c-4f81-83c9-be444b539a7f tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:38.769911 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-df9b52df-cf6c-4f81-83c9-be444b539a7f tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:38.770763 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-df9b52df-cf6c-4f81-83c9-be444b539a7f tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:38.771309 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-df9b52df-cf6c-4f81-83c9-be444b539a7f tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:38.909181 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-df9b52df-cf6c-4f81-83c9-be444b539a7f tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:38.917883 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-df9b52df-cf6c-4f81-83c9-be444b539a7f tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:38.924717 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-df9b52df-cf6c-4f81-83c9-be444b539a7f tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:38.924717 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-df9b52df-cf6c-4f81-83c9-be444b539a7f tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5" status: 200 len: 1743 microversion: 2.20 time: 0.164617 Aug 02 11:00:38.924717 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 342/687] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 11:00:38 2022] GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5 => generated 1743 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 11:00:39.947169 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-1063b1c7-b4fa-4623-8e40-37188e4534ad tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:39.947781 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-1063b1c7-b4fa-4623-8e40-37188e4534ad tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: f86a8852-12b8-46d3-bd9b-bc140757b4c5] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:39.954420 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-1063b1c7-b4fa-4623-8e40-37188e4534ad tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:39.954869 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-1063b1c7-b4fa-4623-8e40-37188e4534ad tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:39.955711 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-1063b1c7-b4fa-4623-8e40-37188e4534ad tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:39.956145 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-1063b1c7-b4fa-4623-8e40-37188e4534ad tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:40.101562 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [req-9d69e79e-6cf6-42ff-857a-a4fe9d16986b req-f0cbb941-04f2-471d-a5bc-d80e9f950319 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bca2caf3-fc41-4e08-b3ac-476df1fac08b", "tag": "3c75c1d1-beb4-4085-beda-a9f460b8bf87"}]} {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 11:00:40.112963 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [req-9d69e79e-6cf6-42ff-857a-a4fe9d16986b req-f0cbb941-04f2-471d-a5bc-d80e9f950319 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:40.116548 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-1063b1c7-b4fa-4623-8e40-37188e4534ad tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:40.120702 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [req-9d69e79e-6cf6-42ff-857a-a4fe9d16986b req-f0cbb941-04f2-471d-a5bc-d80e9f950319 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:40.129313 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-1063b1c7-b4fa-4623-8e40-37188e4534ad tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:40.131319 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-1063b1c7-b4fa-4623-8e40-37188e4534ad tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:40.135326 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-1063b1c7-b4fa-4623-8e40-37188e4534ad tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5" status: 200 len: 1743 microversion: 2.20 time: 0.189376 Aug 02 11:00:40.136184 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 346/688] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 11:00:39 2022] GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5 => generated 1743 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 11:00:40.143128 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.compute.server_external_events [req-9d69e79e-6cf6-42ff-857a-a4fe9d16986b req-f0cbb941-04f2-471d-a5bc-d80e9f950319 service nova] Creating event network-changed:3c75c1d1-beb4-4085-beda-a9f460b8bf87 for instance bca2caf3-fc41-4e08-b3ac-476df1fac08b on hv-cinder-85031 Aug 02 11:00:40.148359 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [req-9d69e79e-6cf6-42ff-857a-a4fe9d16986b req-f0cbb941-04f2-471d-a5bc-d80e9f950319 service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129602 Aug 02 11:00:40.149646 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 343/689] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Aug 2 11:00:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 11:00:40.604595 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-f30a80c0-4629-4122-a10b-1188dcd9db45 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 11:00:40.605074 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-f30a80c0-4629-4122-a10b-1188dcd9db45 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] [instance: 254a6894-dcb1-4909-a24e-a3a9bf701a83] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:40.611269 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-f30a80c0-4629-4122-a10b-1188dcd9db45 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:40.611667 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-f30a80c0-4629-4122-a10b-1188dcd9db45 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:40.612431 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-f30a80c0-4629-4122-a10b-1188dcd9db45 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:40.612863 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-f30a80c0-4629-4122-a10b-1188dcd9db45 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:40.636557 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.objects.instance [None req-f30a80c0-4629-4122-a10b-1188dcd9db45 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lazy-loading 'flavor' on Instance uuid 254a6894-dcb1-4909-a24e-a3a9bf701a83 {{(pid=129953) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 11:00:40.974097 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-f30a80c0-4629-4122-a10b-1188dcd9db45 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] 10.222.0.115 "POST /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83/action" status: 202 len: 0 microversion: 2.1 time: 0.374041 Aug 02 11:00:40.978244 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 347/690] 10.222.0.115 () {60 vars in 1283 bytes} [Tue Aug 2 11:00:40 2022] POST /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83/action => generated 0 bytes in 376 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 11:00:40.984529 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-e9fe632a-f35c-4cb7-8e4c-5ce919db76ce tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:40.987951 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-e9fe632a-f35c-4cb7-8e4c-5ce919db76ce tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] [instance: 254a6894-dcb1-4909-a24e-a3a9bf701a83] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:40.993661 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-e9fe632a-f35c-4cb7-8e4c-5ce919db76ce tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:40.994131 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-e9fe632a-f35c-4cb7-8e4c-5ce919db76ce tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:40.994914 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-e9fe632a-f35c-4cb7-8e4c-5ce919db76ce tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:40.995395 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-e9fe632a-f35c-4cb7-8e4c-5ce919db76ce tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:41.159579 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-23eb4fc5-4f44-49ef-b0b6-e0691b372819 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:41.160706 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-23eb4fc5-4f44-49ef-b0b6-e0691b372819 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: f86a8852-12b8-46d3-bd9b-bc140757b4c5] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:41.169300 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-23eb4fc5-4f44-49ef-b0b6-e0691b372819 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:41.170137 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-23eb4fc5-4f44-49ef-b0b6-e0691b372819 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:41.171280 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-23eb4fc5-4f44-49ef-b0b6-e0691b372819 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:41.171882 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-23eb4fc5-4f44-49ef-b0b6-e0691b372819 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:41.267271 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-e9fe632a-f35c-4cb7-8e4c-5ce919db76ce tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2664b70cbc1a41a59f78b0b7d4e86643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd54719e5f2b41e6a875361a9188d49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:41.276839 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-e9fe632a-f35c-4cb7-8e4c-5ce919db76ce tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] 10.222.0.115 "GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83" status: 200 len: 1570 microversion: 2.1 time: 0.296925 Aug 02 11:00:41.277911 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 344/691] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:00:40 2022] GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83 => generated 1570 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:00:41.399717 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-23eb4fc5-4f44-49ef-b0b6-e0691b372819 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:41.406237 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-23eb4fc5-4f44-49ef-b0b6-e0691b372819 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:41.407782 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-23eb4fc5-4f44-49ef-b0b6-e0691b372819 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:41.408956 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-23eb4fc5-4f44-49ef-b0b6-e0691b372819 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5" status: 200 len: 1725 microversion: 2.20 time: 0.254193 Aug 02 11:00:41.409515 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 348/692] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 11:00:41 2022] GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5 => generated 1725 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 11:00:42.299354 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-1c0a5472-aeb1-479a-a3bf-7b9b23fee7d3 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:42.300079 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-1c0a5472-aeb1-479a-a3bf-7b9b23fee7d3 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] [instance: 254a6894-dcb1-4909-a24e-a3a9bf701a83] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:42.302537 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG dbcounter [-] [129952] Writing DB stats nova_api:SELECT=89 {{(pid=129952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 11:00:42.308150 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-1c0a5472-aeb1-479a-a3bf-7b9b23fee7d3 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:42.308602 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-1c0a5472-aeb1-479a-a3bf-7b9b23fee7d3 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:42.309367 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-1c0a5472-aeb1-479a-a3bf-7b9b23fee7d3 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:42.309804 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-1c0a5472-aeb1-479a-a3bf-7b9b23fee7d3 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:42.434037 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-c1a866c9-878e-4e98-a969-987fca31d74b tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:42.434821 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-c1a866c9-878e-4e98-a969-987fca31d74b tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: f86a8852-12b8-46d3-bd9b-bc140757b4c5] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:42.441997 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-c1a866c9-878e-4e98-a969-987fca31d74b tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:42.442410 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-c1a866c9-878e-4e98-a969-987fca31d74b tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:42.443204 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-c1a866c9-878e-4e98-a969-987fca31d74b tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:42.443632 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-c1a866c9-878e-4e98-a969-987fca31d74b tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:42.444365 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-1c0a5472-aeb1-479a-a3bf-7b9b23fee7d3 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2664b70cbc1a41a59f78b0b7d4e86643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd54719e5f2b41e6a875361a9188d49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:42.453013 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-1c0a5472-aeb1-479a-a3bf-7b9b23fee7d3 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] 10.222.0.115 "GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83" status: 200 len: 1570 microversion: 2.1 time: 0.157400 Aug 02 11:00:42.459335 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 345/693] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:00:42 2022] GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83 => generated 1570 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:00:42.579080 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-c1a866c9-878e-4e98-a969-987fca31d74b tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:42.587597 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-c1a866c9-878e-4e98-a969-987fca31d74b tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:42.589093 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-c1a866c9-878e-4e98-a969-987fca31d74b tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:42.590237 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-c1a866c9-878e-4e98-a969-987fca31d74b tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5" status: 200 len: 1725 microversion: 2.20 time: 0.160631 Aug 02 11:00:42.590783 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 349/694] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 11:00:42 2022] GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5 => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 11:00:43.475259 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-aea79fc7-eaa3-441e-ba2b-82d0abb610a6 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:43.475897 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-aea79fc7-eaa3-441e-ba2b-82d0abb610a6 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] [instance: 254a6894-dcb1-4909-a24e-a3a9bf701a83] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:43.483179 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-aea79fc7-eaa3-441e-ba2b-82d0abb610a6 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:43.483699 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-aea79fc7-eaa3-441e-ba2b-82d0abb610a6 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:43.484558 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-aea79fc7-eaa3-441e-ba2b-82d0abb610a6 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:43.484995 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-aea79fc7-eaa3-441e-ba2b-82d0abb610a6 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:43.613602 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-0aab1094-e0cf-4976-a31b-2e3c0e7f1af2 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:43.614474 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-0aab1094-e0cf-4976-a31b-2e3c0e7f1af2 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: f86a8852-12b8-46d3-bd9b-bc140757b4c5] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:43.621931 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-0aab1094-e0cf-4976-a31b-2e3c0e7f1af2 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:43.622377 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-0aab1094-e0cf-4976-a31b-2e3c0e7f1af2 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:43.622711 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-aea79fc7-eaa3-441e-ba2b-82d0abb610a6 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2664b70cbc1a41a59f78b0b7d4e86643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd54719e5f2b41e6a875361a9188d49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:43.623163 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-0aab1094-e0cf-4976-a31b-2e3c0e7f1af2 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:43.623599 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-0aab1094-e0cf-4976-a31b-2e3c0e7f1af2 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:43.630311 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-aea79fc7-eaa3-441e-ba2b-82d0abb610a6 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] 10.222.0.115 "GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83" status: 200 len: 1570 microversion: 2.1 time: 0.158993 Aug 02 11:00:43.630880 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 346/695] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:00:43 2022] GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83 => generated 1570 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:00:43.755753 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-0aab1094-e0cf-4976-a31b-2e3c0e7f1af2 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:43.763738 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-0aab1094-e0cf-4976-a31b-2e3c0e7f1af2 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:43.765219 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-0aab1094-e0cf-4976-a31b-2e3c0e7f1af2 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:43.766358 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-0aab1094-e0cf-4976-a31b-2e3c0e7f1af2 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5" status: 200 len: 1725 microversion: 2.20 time: 0.156718 Aug 02 11:00:43.766910 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 350/696] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 11:00:43 2022] GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 11:00:44.303805 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [req-45cf1f1a-13d7-45e2-8b47-b537989fe66a req-03b0ef2c-c8a6-424d-92b3-b8668b569975 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f86a8852-12b8-46d3-bd9b-bc140757b4c5", "name": "network-vif-unplugged", "status": "completed", "tag": "b19c6f76-3eb2-428e-95c9-247e8c1ea7c5"}]} {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 11:00:44.313744 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [req-45cf1f1a-13d7-45e2-8b47-b537989fe66a req-03b0ef2c-c8a6-424d-92b3-b8668b569975 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:44.314195 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [req-45cf1f1a-13d7-45e2-8b47-b537989fe66a req-03b0ef2c-c8a6-424d-92b3-b8668b569975 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:44.326180 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.compute.server_external_events [req-45cf1f1a-13d7-45e2-8b47-b537989fe66a req-03b0ef2c-c8a6-424d-92b3-b8668b569975 service nova] Creating event network-vif-unplugged:b19c6f76-3eb2-428e-95c9-247e8c1ea7c5 for instance f86a8852-12b8-46d3-bd9b-bc140757b4c5 on hv-cinder-85031 Aug 02 11:00:44.331197 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [req-45cf1f1a-13d7-45e2-8b47-b537989fe66a req-03b0ef2c-c8a6-424d-92b3-b8668b569975 service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.086417 Aug 02 11:00:44.331795 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 347/697] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Aug 2 11:00:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 11:00:44.652569 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-0d2f9ab2-eb9c-42c2-8fe1-3359fc6785c4 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:44.653145 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-0d2f9ab2-eb9c-42c2-8fe1-3359fc6785c4 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] [instance: 254a6894-dcb1-4909-a24e-a3a9bf701a83] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:44.659960 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-0d2f9ab2-eb9c-42c2-8fe1-3359fc6785c4 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:44.660412 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-0d2f9ab2-eb9c-42c2-8fe1-3359fc6785c4 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:44.661206 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-0d2f9ab2-eb9c-42c2-8fe1-3359fc6785c4 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:44.661627 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-0d2f9ab2-eb9c-42c2-8fe1-3359fc6785c4 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:44.791477 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-7dd8deb2-c37a-4ba3-a62a-71bd148efc75 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:44.792163 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-7dd8deb2-c37a-4ba3-a62a-71bd148efc75 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: f86a8852-12b8-46d3-bd9b-bc140757b4c5] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:44.798957 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-7dd8deb2-c37a-4ba3-a62a-71bd148efc75 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:44.799349 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-7dd8deb2-c37a-4ba3-a62a-71bd148efc75 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:44.800124 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-7dd8deb2-c37a-4ba3-a62a-71bd148efc75 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:44.800554 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-7dd8deb2-c37a-4ba3-a62a-71bd148efc75 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:44.801611 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-0d2f9ab2-eb9c-42c2-8fe1-3359fc6785c4 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2664b70cbc1a41a59f78b0b7d4e86643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd54719e5f2b41e6a875361a9188d49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:44.810242 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-0d2f9ab2-eb9c-42c2-8fe1-3359fc6785c4 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] 10.222.0.115 "GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83" status: 200 len: 1570 microversion: 2.1 time: 0.162508 Aug 02 11:00:44.810818 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 351/698] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:00:44 2022] GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83 => generated 1570 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:00:44.942487 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-7dd8deb2-c37a-4ba3-a62a-71bd148efc75 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:44.951533 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-7dd8deb2-c37a-4ba3-a62a-71bd148efc75 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:44.953049 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-7dd8deb2-c37a-4ba3-a62a-71bd148efc75 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:44.954269 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-7dd8deb2-c37a-4ba3-a62a-71bd148efc75 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5" status: 200 len: 1728 microversion: 2.20 time: 0.167858 Aug 02 11:00:44.954828 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 348/699] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 11:00:44 2022] GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5 => generated 1728 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 11:00:44.977251 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-a1d2ec70-ea79-4c4b-a6dd-49d90e32e736 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d566bdff-21e8-4d81-ace8-8521b772fc94"}} {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 11:00:44.979746 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-a1d2ec70-ea79-4c4b-a6dd-49d90e32e736 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: f86a8852-12b8-46d3-bd9b-bc140757b4c5] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:44.985815 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-a1d2ec70-ea79-4c4b-a6dd-49d90e32e736 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:44.986259 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-a1d2ec70-ea79-4c4b-a6dd-49d90e32e736 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:44.987015 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-a1d2ec70-ea79-4c4b-a6dd-49d90e32e736 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:44.987470 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-a1d2ec70-ea79-4c4b-a6dd-49d90e32e736 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:45.832728 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-84b1d90e-04c3-4a5a-8406-c7907031941e tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:45.835755 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-84b1d90e-04c3-4a5a-8406-c7907031941e tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] [instance: 254a6894-dcb1-4909-a24e-a3a9bf701a83] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:45.840550 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-84b1d90e-04c3-4a5a-8406-c7907031941e tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:45.841087 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-84b1d90e-04c3-4a5a-8406-c7907031941e tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:45.841890 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-84b1d90e-04c3-4a5a-8406-c7907031941e tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:45.842305 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-84b1d90e-04c3-4a5a-8406-c7907031941e tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:45.982082 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-84b1d90e-04c3-4a5a-8406-c7907031941e tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2664b70cbc1a41a59f78b0b7d4e86643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd54719e5f2b41e6a875361a9188d49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:45.989792 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-84b1d90e-04c3-4a5a-8406-c7907031941e tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] 10.222.0.115 "GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83" status: 200 len: 1570 microversion: 2.1 time: 0.160957 Aug 02 11:00:45.990464 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 349/700] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:00:45 2022] GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83 => generated 1570 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 11:00:46.003329 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-a1d2ec70-ea79-4c4b-a6dd-49d90e32e736 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "POST /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.030237 Aug 02 11:00:46.004177 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 352/701] 10.222.0.115 () {62 vars in 1369 bytes} [Tue Aug 2 11:00:44 2022] POST /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5/os-volume_attachments => generated 188 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 11:00:46.126726 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-feb8705d-0801-4bc2-a5ae-381013c2035b tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:46.127257 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-feb8705d-0801-4bc2-a5ae-381013c2035b tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: f86a8852-12b8-46d3-bd9b-bc140757b4c5] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:46.133415 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-feb8705d-0801-4bc2-a5ae-381013c2035b tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:46.133721 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-feb8705d-0801-4bc2-a5ae-381013c2035b tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:46.134485 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-feb8705d-0801-4bc2-a5ae-381013c2035b tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:46.134912 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-feb8705d-0801-4bc2-a5ae-381013c2035b tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:46.706187 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-feb8705d-0801-4bc2-a5ae-381013c2035b tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "DELETE /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5/os-volume_attachments/d566bdff-21e8-4d81-ace8-8521b772fc94" status: 202 len: 0 microversion: 2.20 time: 0.583238 Aug 02 11:00:46.706729 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 350/702] 10.222.0.115 () {60 vars in 1462 bytes} [Tue Aug 2 11:00:46 2022] DELETE /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5/os-volume_attachments/d566bdff-21e8-4d81-ace8-8521b772fc94 => generated 0 bytes in 585 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 02 11:00:46.767222 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-b0f1321b-110f-4b71-a3c0-6ee220070ed1 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 11:00:46.767811 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-b0f1321b-110f-4b71-a3c0-6ee220070ed1 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: f86a8852-12b8-46d3-bd9b-bc140757b4c5] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:46.777567 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-b0f1321b-110f-4b71-a3c0-6ee220070ed1 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:46.778010 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-b0f1321b-110f-4b71-a3c0-6ee220070ed1 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:46.778774 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-b0f1321b-110f-4b71-a3c0-6ee220070ed1 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:46.779275 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-b0f1321b-110f-4b71-a3c0-6ee220070ed1 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:46.808000 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-b0f1321b-110f-4b71-a3c0-6ee220070ed1 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: f86a8852-12b8-46d3-bd9b-bc140757b4c5] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=129953) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 02 11:00:47.012914 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-a311d3ac-6336-4631-a84d-15a0c7cd701d tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:47.015650 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-a311d3ac-6336-4631-a84d-15a0c7cd701d tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] [instance: 254a6894-dcb1-4909-a24e-a3a9bf701a83] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:47.021523 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-a311d3ac-6336-4631-a84d-15a0c7cd701d tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:47.022024 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-a311d3ac-6336-4631-a84d-15a0c7cd701d tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:47.022799 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-a311d3ac-6336-4631-a84d-15a0c7cd701d tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:47.023262 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-a311d3ac-6336-4631-a84d-15a0c7cd701d tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:47.101408 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-b0f1321b-110f-4b71-a3c0-6ee220070ed1 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "POST /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5/action" status: 202 len: 0 microversion: 2.20 time: 0.338128 Aug 02 11:00:47.102257 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 353/703] 10.222.0.115 () {62 vars in 1324 bytes} [Tue Aug 2 11:00:46 2022] POST /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5/action => generated 0 bytes in 340 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 02 11:00:47.114038 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-085f4fb3-a8bf-4384-9c83-fd2269ab70e4 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:47.114378 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-085f4fb3-a8bf-4384-9c83-fd2269ab70e4 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: f86a8852-12b8-46d3-bd9b-bc140757b4c5] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:47.122693 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-085f4fb3-a8bf-4384-9c83-fd2269ab70e4 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:47.123169 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-085f4fb3-a8bf-4384-9c83-fd2269ab70e4 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:47.124034 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-085f4fb3-a8bf-4384-9c83-fd2269ab70e4 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:47.124498 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-085f4fb3-a8bf-4384-9c83-fd2269ab70e4 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:47.175791 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-a311d3ac-6336-4631-a84d-15a0c7cd701d tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2664b70cbc1a41a59f78b0b7d4e86643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd54719e5f2b41e6a875361a9188d49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:47.184319 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-a311d3ac-6336-4631-a84d-15a0c7cd701d tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] 10.222.0.115 "GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83" status: 200 len: 1570 microversion: 2.1 time: 0.175720 Aug 02 11:00:47.184911 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 351/704] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:00:47 2022] GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83 => generated 1570 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:00:47.274012 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-085f4fb3-a8bf-4384-9c83-fd2269ab70e4 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:47.276799 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG dbcounter [-] [129953] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=7,nova_cell1:INSERT=5 {{(pid=129953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 11:00:47.281907 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-085f4fb3-a8bf-4384-9c83-fd2269ab70e4 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:47.283467 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-085f4fb3-a8bf-4384-9c83-fd2269ab70e4 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:47.284754 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-085f4fb3-a8bf-4384-9c83-fd2269ab70e4 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5" status: 200 len: 1676 microversion: 2.20 time: 0.177375 Aug 02 11:00:47.285309 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 354/705] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 11:00:47 2022] GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5 => generated 1676 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 11:00:48.207729 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-7e58ff3b-5e3b-47dd-9751-c1f977a52c42 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:48.208487 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-7e58ff3b-5e3b-47dd-9751-c1f977a52c42 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] [instance: 254a6894-dcb1-4909-a24e-a3a9bf701a83] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:48.215509 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-7e58ff3b-5e3b-47dd-9751-c1f977a52c42 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:48.215786 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-7e58ff3b-5e3b-47dd-9751-c1f977a52c42 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:48.216551 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-7e58ff3b-5e3b-47dd-9751-c1f977a52c42 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:48.217014 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-7e58ff3b-5e3b-47dd-9751-c1f977a52c42 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:48.309048 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-6d8c2528-80d3-4e90-b6f1-1a7fba2ee755 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:48.311342 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-6d8c2528-80d3-4e90-b6f1-1a7fba2ee755 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: f86a8852-12b8-46d3-bd9b-bc140757b4c5] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:48.317298 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-6d8c2528-80d3-4e90-b6f1-1a7fba2ee755 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:48.317746 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-6d8c2528-80d3-4e90-b6f1-1a7fba2ee755 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:48.318511 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-6d8c2528-80d3-4e90-b6f1-1a7fba2ee755 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:48.318943 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-6d8c2528-80d3-4e90-b6f1-1a7fba2ee755 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:48.359561 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-7e58ff3b-5e3b-47dd-9751-c1f977a52c42 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2664b70cbc1a41a59f78b0b7d4e86643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd54719e5f2b41e6a875361a9188d49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:48.368314 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-7e58ff3b-5e3b-47dd-9751-c1f977a52c42 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] 10.222.0.115 "GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83" status: 200 len: 1570 microversion: 2.1 time: 0.164448 Aug 02 11:00:48.369959 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 352/706] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:00:48 2022] GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83 => generated 1570 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 11:00:48.458586 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-6d8c2528-80d3-4e90-b6f1-1a7fba2ee755 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:48.467316 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-6d8c2528-80d3-4e90-b6f1-1a7fba2ee755 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:48.468892 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-6d8c2528-80d3-4e90-b6f1-1a7fba2ee755 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:48.470076 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-6d8c2528-80d3-4e90-b6f1-1a7fba2ee755 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5" status: 200 len: 1676 microversion: 2.20 time: 0.165655 Aug 02 11:00:48.470683 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 355/707] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 11:00:48 2022] GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5 => generated 1676 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 11:00:49.391574 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-b517d885-a5d3-430c-8316-b74c9deb2f47 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:49.392177 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-b517d885-a5d3-430c-8316-b74c9deb2f47 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] [instance: 254a6894-dcb1-4909-a24e-a3a9bf701a83] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:49.399622 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-b517d885-a5d3-430c-8316-b74c9deb2f47 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:49.400308 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-b517d885-a5d3-430c-8316-b74c9deb2f47 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:49.400965 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-b517d885-a5d3-430c-8316-b74c9deb2f47 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:49.401435 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-b517d885-a5d3-430c-8316-b74c9deb2f47 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:49.494367 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-4f1c3da2-702b-414a-85c8-c090f74ef573 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:49.495090 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-4f1c3da2-702b-414a-85c8-c090f74ef573 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: f86a8852-12b8-46d3-bd9b-bc140757b4c5] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:49.502249 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-4f1c3da2-702b-414a-85c8-c090f74ef573 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:49.502617 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-4f1c3da2-702b-414a-85c8-c090f74ef573 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:49.503424 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-4f1c3da2-702b-414a-85c8-c090f74ef573 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:49.503856 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-4f1c3da2-702b-414a-85c8-c090f74ef573 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:49.690189 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-b517d885-a5d3-430c-8316-b74c9deb2f47 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2664b70cbc1a41a59f78b0b7d4e86643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd54719e5f2b41e6a875361a9188d49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:49.698147 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-b517d885-a5d3-430c-8316-b74c9deb2f47 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] 10.222.0.115 "GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83" status: 200 len: 1570 microversion: 2.1 time: 0.310639 Aug 02 11:00:49.698830 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 353/708] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:00:49 2022] GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83 => generated 1570 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:00:49.732229 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-4f1c3da2-702b-414a-85c8-c090f74ef573 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:49.740272 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-4f1c3da2-702b-414a-85c8-c090f74ef573 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:49.741825 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-4f1c3da2-702b-414a-85c8-c090f74ef573 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:49.742950 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-4f1c3da2-702b-414a-85c8-c090f74ef573 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5" status: 200 len: 1734 microversion: 2.20 time: 0.253111 Aug 02 11:00:49.743613 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 356/709] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 11:00:49 2022] GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5 => generated 1734 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 11:00:50.719918 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-9f5dcc9a-e388-403e-ad2c-a50a39d6d1fa tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:50.720467 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-9f5dcc9a-e388-403e-ad2c-a50a39d6d1fa tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] [instance: 254a6894-dcb1-4909-a24e-a3a9bf701a83] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:50.727396 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-9f5dcc9a-e388-403e-ad2c-a50a39d6d1fa tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:50.727863 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-9f5dcc9a-e388-403e-ad2c-a50a39d6d1fa tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:50.729357 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-9f5dcc9a-e388-403e-ad2c-a50a39d6d1fa tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:50.729977 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-9f5dcc9a-e388-403e-ad2c-a50a39d6d1fa tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:50.766592 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-888c2d73-bbb6-44ea-b7c6-35849b58621e tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:50.768750 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-888c2d73-bbb6-44ea-b7c6-35849b58621e tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: f86a8852-12b8-46d3-bd9b-bc140757b4c5] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:50.776582 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-888c2d73-bbb6-44ea-b7c6-35849b58621e tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:50.778522 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-888c2d73-bbb6-44ea-b7c6-35849b58621e tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:50.779685 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-888c2d73-bbb6-44ea-b7c6-35849b58621e tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:50.780306 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-888c2d73-bbb6-44ea-b7c6-35849b58621e tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:50.948238 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-9f5dcc9a-e388-403e-ad2c-a50a39d6d1fa tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2664b70cbc1a41a59f78b0b7d4e86643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd54719e5f2b41e6a875361a9188d49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:50.957803 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-9f5dcc9a-e388-403e-ad2c-a50a39d6d1fa tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] 10.222.0.115 "GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83" status: 200 len: 1570 microversion: 2.1 time: 0.241523 Aug 02 11:00:50.958974 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 354/710] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:00:50 2022] GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83 => generated 1570 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:00:50.980688 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-888c2d73-bbb6-44ea-b7c6-35849b58621e tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:50.989798 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-888c2d73-bbb6-44ea-b7c6-35849b58621e tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:50.991346 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-888c2d73-bbb6-44ea-b7c6-35849b58621e tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:50.992512 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-888c2d73-bbb6-44ea-b7c6-35849b58621e tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5" status: 200 len: 1734 microversion: 2.20 time: 0.229840 Aug 02 11:00:50.993089 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 357/711] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 11:00:50 2022] GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5 => generated 1734 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 11:00:51.980928 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-4d6b3b5b-a69e-4dfa-8cb0-8d274d163d99 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:51.981730 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-4d6b3b5b-a69e-4dfa-8cb0-8d274d163d99 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] [instance: 254a6894-dcb1-4909-a24e-a3a9bf701a83] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:51.988482 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-4d6b3b5b-a69e-4dfa-8cb0-8d274d163d99 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:51.988936 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-4d6b3b5b-a69e-4dfa-8cb0-8d274d163d99 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:51.989780 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-4d6b3b5b-a69e-4dfa-8cb0-8d274d163d99 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:51.990164 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-4d6b3b5b-a69e-4dfa-8cb0-8d274d163d99 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:52.016327 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-0cc6d341-81ac-44be-80d5-837428892c1d tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:52.016933 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-0cc6d341-81ac-44be-80d5-837428892c1d tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: f86a8852-12b8-46d3-bd9b-bc140757b4c5] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:52.023710 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-0cc6d341-81ac-44be-80d5-837428892c1d tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:52.024160 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-0cc6d341-81ac-44be-80d5-837428892c1d tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:52.025910 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-0cc6d341-81ac-44be-80d5-837428892c1d tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:52.026346 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-0cc6d341-81ac-44be-80d5-837428892c1d tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:52.213845 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-4d6b3b5b-a69e-4dfa-8cb0-8d274d163d99 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2664b70cbc1a41a59f78b0b7d4e86643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd54719e5f2b41e6a875361a9188d49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:52.222198 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-4d6b3b5b-a69e-4dfa-8cb0-8d274d163d99 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] 10.222.0.115 "GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83" status: 200 len: 1570 microversion: 2.1 time: 0.245782 Aug 02 11:00:52.222784 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 355/712] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:00:51 2022] GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83 => generated 1570 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:00:52.225880 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-0cc6d341-81ac-44be-80d5-837428892c1d tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:52.233837 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-0cc6d341-81ac-44be-80d5-837428892c1d tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:52.235349 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-0cc6d341-81ac-44be-80d5-837428892c1d tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:52.236491 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-0cc6d341-81ac-44be-80d5-837428892c1d tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5" status: 200 len: 1734 microversion: 2.20 time: 0.224156 Aug 02 11:00:52.237044 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 358/713] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 11:00:52 2022] GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5 => generated 1734 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 11:00:53.244635 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-02a043b7-8bf1-4ddd-b629-fd263d170d33 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:53.245369 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-02a043b7-8bf1-4ddd-b629-fd263d170d33 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] [instance: 254a6894-dcb1-4909-a24e-a3a9bf701a83] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:53.252607 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-02a043b7-8bf1-4ddd-b629-fd263d170d33 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:53.253052 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-02a043b7-8bf1-4ddd-b629-fd263d170d33 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:53.253811 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-02a043b7-8bf1-4ddd-b629-fd263d170d33 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:53.254273 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-02a043b7-8bf1-4ddd-b629-fd263d170d33 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:53.260629 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-75f202e2-e9d6-4ff1-bfbd-152936923ef4 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:53.261863 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-75f202e2-e9d6-4ff1-bfbd-152936923ef4 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: f86a8852-12b8-46d3-bd9b-bc140757b4c5] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:53.267902 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-75f202e2-e9d6-4ff1-bfbd-152936923ef4 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:53.268347 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-75f202e2-e9d6-4ff1-bfbd-152936923ef4 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:53.269144 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-75f202e2-e9d6-4ff1-bfbd-152936923ef4 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:53.269575 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-75f202e2-e9d6-4ff1-bfbd-152936923ef4 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:53.270675 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG dbcounter [-] [129952] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=129952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 11:00:53.463579 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-02a043b7-8bf1-4ddd-b629-fd263d170d33 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2664b70cbc1a41a59f78b0b7d4e86643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd54719e5f2b41e6a875361a9188d49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:53.471704 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-02a043b7-8bf1-4ddd-b629-fd263d170d33 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] 10.222.0.115 "GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83" status: 200 len: 1570 microversion: 2.1 time: 0.231698 Aug 02 11:00:53.472583 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 356/714] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:00:53 2022] GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83 => generated 1570 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:00:53.476235 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-75f202e2-e9d6-4ff1-bfbd-152936923ef4 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:53.484824 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-75f202e2-e9d6-4ff1-bfbd-152936923ef4 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:53.486313 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-75f202e2-e9d6-4ff1-bfbd-152936923ef4 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:53.487570 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-75f202e2-e9d6-4ff1-bfbd-152936923ef4 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5" status: 200 len: 1734 microversion: 2.20 time: 0.231358 Aug 02 11:00:53.488118 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 359/715] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 11:00:53 2022] GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5 => generated 1734 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 11:00:54.494042 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-05328560-1e38-43de-8b66-0c5957a1a183 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:54.494645 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-05328560-1e38-43de-8b66-0c5957a1a183 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] [instance: 254a6894-dcb1-4909-a24e-a3a9bf701a83] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:54.502423 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-05328560-1e38-43de-8b66-0c5957a1a183 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:54.502996 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-05328560-1e38-43de-8b66-0c5957a1a183 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:54.503864 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-05328560-1e38-43de-8b66-0c5957a1a183 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:54.505768 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-05328560-1e38-43de-8b66-0c5957a1a183 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:54.511710 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-23c2e160-5824-4078-bd2b-93ad17cad1b4 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:54.512323 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-23c2e160-5824-4078-bd2b-93ad17cad1b4 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: f86a8852-12b8-46d3-bd9b-bc140757b4c5] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:54.519328 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-23c2e160-5824-4078-bd2b-93ad17cad1b4 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:54.519773 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-23c2e160-5824-4078-bd2b-93ad17cad1b4 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:54.520537 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-23c2e160-5824-4078-bd2b-93ad17cad1b4 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:54.521026 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-23c2e160-5824-4078-bd2b-93ad17cad1b4 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:54.721192 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-05328560-1e38-43de-8b66-0c5957a1a183 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2664b70cbc1a41a59f78b0b7d4e86643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd54719e5f2b41e6a875361a9188d49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:54.730919 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-23c2e160-5824-4078-bd2b-93ad17cad1b4 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:54.737948 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-05328560-1e38-43de-8b66-0c5957a1a183 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] 10.222.0.115 "GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83" status: 200 len: 1570 microversion: 2.1 time: 0.247874 Aug 02 11:00:54.738547 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 357/716] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:00:54 2022] GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83 => generated 1570 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:00:54.739415 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-23c2e160-5824-4078-bd2b-93ad17cad1b4 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:54.741106 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-23c2e160-5824-4078-bd2b-93ad17cad1b4 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:54.742288 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-23c2e160-5824-4078-bd2b-93ad17cad1b4 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5" status: 200 len: 1734 microversion: 2.20 time: 0.235201 Aug 02 11:00:54.743113 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 360/717] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 11:00:54 2022] GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5 => generated 1734 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 11:00:55.765531 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-80d89042-b879-449e-8734-09e6a13dda14 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:55.766420 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-80d89042-b879-449e-8734-09e6a13dda14 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] [instance: 254a6894-dcb1-4909-a24e-a3a9bf701a83] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:55.766801 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-672fd55d-bcca-4260-bb30-370e2e75ac32 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:55.768284 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-672fd55d-bcca-4260-bb30-370e2e75ac32 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: f86a8852-12b8-46d3-bd9b-bc140757b4c5] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:55.772991 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-80d89042-b879-449e-8734-09e6a13dda14 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:55.773435 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-80d89042-b879-449e-8734-09e6a13dda14 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:55.774214 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-80d89042-b879-449e-8734-09e6a13dda14 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:55.774649 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-80d89042-b879-449e-8734-09e6a13dda14 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:55.775648 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-672fd55d-bcca-4260-bb30-370e2e75ac32 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:55.777091 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-672fd55d-bcca-4260-bb30-370e2e75ac32 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:55.778055 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-672fd55d-bcca-4260-bb30-370e2e75ac32 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:55.778554 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-672fd55d-bcca-4260-bb30-370e2e75ac32 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:55.995850 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-672fd55d-bcca-4260-bb30-370e2e75ac32 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:55.996991 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-80d89042-b879-449e-8734-09e6a13dda14 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2664b70cbc1a41a59f78b0b7d4e86643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd54719e5f2b41e6a875361a9188d49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:56.004922 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-80d89042-b879-449e-8734-09e6a13dda14 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] 10.222.0.115 "GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83" status: 200 len: 1570 microversion: 2.1 time: 0.244151 Aug 02 11:00:56.005609 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 358/718] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:00:55 2022] GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83 => generated 1570 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:00:56.008229 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-672fd55d-bcca-4260-bb30-370e2e75ac32 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:56.009719 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-672fd55d-bcca-4260-bb30-370e2e75ac32 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:56.011678 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-672fd55d-bcca-4260-bb30-370e2e75ac32 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5" status: 200 len: 1734 microversion: 2.20 time: 0.249226 Aug 02 11:00:56.012222 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 361/719] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 11:00:55 2022] GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5 => generated 1734 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 11:00:57.029171 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-048fc12b-6268-4f17-a7ee-3c7cf8a61b8c tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:57.029793 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-048fc12b-6268-4f17-a7ee-3c7cf8a61b8c tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] [instance: 254a6894-dcb1-4909-a24e-a3a9bf701a83] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:57.035220 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-a17a8db3-2384-4b90-940b-2ac892c88756 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:57.035959 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-a17a8db3-2384-4b90-940b-2ac892c88756 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: f86a8852-12b8-46d3-bd9b-bc140757b4c5] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:57.037522 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-048fc12b-6268-4f17-a7ee-3c7cf8a61b8c tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:57.038123 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-048fc12b-6268-4f17-a7ee-3c7cf8a61b8c tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:57.038923 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-048fc12b-6268-4f17-a7ee-3c7cf8a61b8c tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:57.039379 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-048fc12b-6268-4f17-a7ee-3c7cf8a61b8c tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:57.042901 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-a17a8db3-2384-4b90-940b-2ac892c88756 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:57.043398 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-a17a8db3-2384-4b90-940b-2ac892c88756 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:57.045127 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-a17a8db3-2384-4b90-940b-2ac892c88756 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:57.045605 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-a17a8db3-2384-4b90-940b-2ac892c88756 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:57.253183 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-a17a8db3-2384-4b90-940b-2ac892c88756 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:57.266159 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-a17a8db3-2384-4b90-940b-2ac892c88756 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:57.272320 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-a17a8db3-2384-4b90-940b-2ac892c88756 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:57.273991 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-a17a8db3-2384-4b90-940b-2ac892c88756 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5" status: 200 len: 1734 microversion: 2.20 time: 0.242623 Aug 02 11:00:57.275094 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 362/720] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 11:00:57 2022] GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5 => generated 1734 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 11:00:57.275234 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-048fc12b-6268-4f17-a7ee-3c7cf8a61b8c tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2664b70cbc1a41a59f78b0b7d4e86643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd54719e5f2b41e6a875361a9188d49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:57.284714 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-048fc12b-6268-4f17-a7ee-3c7cf8a61b8c tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] 10.222.0.115 "GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83" status: 200 len: 1570 microversion: 2.1 time: 0.260929 Aug 02 11:00:57.285393 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 359/721] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:00:57 2022] GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83 => generated 1570 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 11:00:57.934638 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-d7460bb4-68e3-4a1b-9cae-fd529a57f66f tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:57.934638 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-d7460bb4-68e3-4a1b-9cae-fd529a57f66f tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] [instance: 93775f02-e62c-4392-a1ed-cfd5dd956dd7] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:57.938874 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-d7460bb4-68e3-4a1b-9cae-fd529a57f66f tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:57.939357 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-d7460bb4-68e3-4a1b-9cae-fd529a57f66f tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:57.940132 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-d7460bb4-68e3-4a1b-9cae-fd529a57f66f tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:57.940564 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-d7460bb4-68e3-4a1b-9cae-fd529a57f66f tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:57.965877 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-d7460bb4-68e3-4a1b-9cae-fd529a57f66f tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] 10.222.0.115 "GET /compute/v2.1/servers/93775f02-e62c-4392-a1ed-cfd5dd956dd7/ips" status: 200 len: 145 microversion: 2.1 time: 0.093197 Aug 02 11:00:57.977310 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 363/722] 10.222.0.115 () {58 vars in 1253 bytes} [Tue Aug 2 11:00:57 2022] GET /compute/v2.1/servers/93775f02-e62c-4392-a1ed-cfd5dd956dd7/ips => generated 145 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 11:00:58.298796 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-3e7f5d51-3009-43f9-b7e9-c2e91085e4c0 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:58.299728 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-3e7f5d51-3009-43f9-b7e9-c2e91085e4c0 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: f86a8852-12b8-46d3-bd9b-bc140757b4c5] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:58.305852 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-dc78673b-6511-45cd-82c5-e596936b808f tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:58.309713 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-dc78673b-6511-45cd-82c5-e596936b808f tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] [instance: 254a6894-dcb1-4909-a24e-a3a9bf701a83] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:58.312945 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-3e7f5d51-3009-43f9-b7e9-c2e91085e4c0 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:58.313531 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-3e7f5d51-3009-43f9-b7e9-c2e91085e4c0 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:58.314820 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-3e7f5d51-3009-43f9-b7e9-c2e91085e4c0 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:58.315334 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-3e7f5d51-3009-43f9-b7e9-c2e91085e4c0 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:58.324102 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-dc78673b-6511-45cd-82c5-e596936b808f tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:58.324844 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-dc78673b-6511-45cd-82c5-e596936b808f tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:58.325820 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-dc78673b-6511-45cd-82c5-e596936b808f tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:58.326253 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-dc78673b-6511-45cd-82c5-e596936b808f tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:58.552623 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-3e7f5d51-3009-43f9-b7e9-c2e91085e4c0 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:58.560201 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-dc78673b-6511-45cd-82c5-e596936b808f tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2664b70cbc1a41a59f78b0b7d4e86643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd54719e5f2b41e6a875361a9188d49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:58.567957 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-3e7f5d51-3009-43f9-b7e9-c2e91085e4c0 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:58.569737 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-3e7f5d51-3009-43f9-b7e9-c2e91085e4c0 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:58.571003 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-3e7f5d51-3009-43f9-b7e9-c2e91085e4c0 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5" status: 200 len: 1734 microversion: 2.20 time: 0.276232 Aug 02 11:00:58.579337 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-dc78673b-6511-45cd-82c5-e596936b808f tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] 10.222.0.115 "GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83" status: 200 len: 1570 microversion: 2.1 time: 0.269040 Aug 02 11:00:58.579337 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 364/723] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:00:58 2022] GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83 => generated 1570 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 11:00:58.579759 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 360/724] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 11:00:58 2022] GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5 => generated 1734 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 11:00:59.594350 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-cdc35ade-3239-434b-ac80-1cd539c41c5e tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:59.594940 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-3f6db382-b554-4f33-ad29-2f8ed957d6cf tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:00:59.595364 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-3f6db382-b554-4f33-ad29-2f8ed957d6cf tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: f86a8852-12b8-46d3-bd9b-bc140757b4c5] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:59.597517 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-cdc35ade-3239-434b-ac80-1cd539c41c5e tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] [instance: 254a6894-dcb1-4909-a24e-a3a9bf701a83] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:59.606022 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-cdc35ade-3239-434b-ac80-1cd539c41c5e tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:59.606473 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-cdc35ade-3239-434b-ac80-1cd539c41c5e tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:59.607303 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-cdc35ade-3239-434b-ac80-1cd539c41c5e tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:59.607727 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-cdc35ade-3239-434b-ac80-1cd539c41c5e tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:59.616646 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-3f6db382-b554-4f33-ad29-2f8ed957d6cf tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:59.617104 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-3f6db382-b554-4f33-ad29-2f8ed957d6cf tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:59.617904 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-3f6db382-b554-4f33-ad29-2f8ed957d6cf tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:59.618343 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-3f6db382-b554-4f33-ad29-2f8ed957d6cf tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:59.857247 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-3f6db382-b554-4f33-ad29-2f8ed957d6cf tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:59.862132 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-cdc35ade-3239-434b-ac80-1cd539c41c5e tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2664b70cbc1a41a59f78b0b7d4e86643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd54719e5f2b41e6a875361a9188d49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:59.881999 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-3f6db382-b554-4f33-ad29-2f8ed957d6cf tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:59.883935 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-cdc35ade-3239-434b-ac80-1cd539c41c5e tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] 10.222.0.115 "GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83" status: 200 len: 1570 microversion: 2.1 time: 0.294906 Aug 02 11:00:59.887026 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-3f6db382-b554-4f33-ad29-2f8ed957d6cf tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:00:59.888465 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 365/725] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:00:59 2022] GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83 => generated 1570 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:00:59.890863 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-3f6db382-b554-4f33-ad29-2f8ed957d6cf tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5" status: 200 len: 1734 microversion: 2.20 time: 0.300232 Aug 02 11:00:59.916037 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 361/726] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 11:00:59 2022] GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5 => generated 1734 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 11:00:59.917417 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-8e45b330-6e59-4dfa-9e3b-e7ea27aa63ee tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9f6e0b60-47e6-4d48-a6ca-f0a4482f30af"}} {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 11:00:59.920324 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-8e45b330-6e59-4dfa-9e3b-e7ea27aa63ee tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] [instance: 93775f02-e62c-4392-a1ed-cfd5dd956dd7] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:00:59.927799 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-8e45b330-6e59-4dfa-9e3b-e7ea27aa63ee tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:59.928333 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-8e45b330-6e59-4dfa-9e3b-e7ea27aa63ee tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:00:59.929178 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-8e45b330-6e59-4dfa-9e3b-e7ea27aa63ee tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:00:59.929678 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-8e45b330-6e59-4dfa-9e3b-e7ea27aa63ee tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:00.910451 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-374909d3-0bff-4ef9-bc1d-105b208dc564 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:00.911277 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-374909d3-0bff-4ef9-bc1d-105b208dc564 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] [instance: 254a6894-dcb1-4909-a24e-a3a9bf701a83] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:00.918615 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-374909d3-0bff-4ef9-bc1d-105b208dc564 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:00.919067 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-374909d3-0bff-4ef9-bc1d-105b208dc564 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:00.919973 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-374909d3-0bff-4ef9-bc1d-105b208dc564 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:00.920263 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-374909d3-0bff-4ef9-bc1d-105b208dc564 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:01.072310 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-374909d3-0bff-4ef9-bc1d-105b208dc564 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2664b70cbc1a41a59f78b0b7d4e86643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd54719e5f2b41e6a875361a9188d49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:01:01.082328 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-374909d3-0bff-4ef9-bc1d-105b208dc564 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] 10.222.0.115 "GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83" status: 200 len: 1570 microversion: 2.1 time: 0.175764 Aug 02 11:01:01.082948 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 362/727] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:01:00 2022] GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83 => generated 1570 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 11:01:01.091261 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-3ef152ed-2a22-402f-a1b0-a72d17cc7d4d tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:01.091880 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-3ef152ed-2a22-402f-a1b0-a72d17cc7d4d tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: f86a8852-12b8-46d3-bd9b-bc140757b4c5] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:01.098863 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-3ef152ed-2a22-402f-a1b0-a72d17cc7d4d tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:01.099710 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-3ef152ed-2a22-402f-a1b0-a72d17cc7d4d tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:01.100637 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-3ef152ed-2a22-402f-a1b0-a72d17cc7d4d tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:01.101178 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-3ef152ed-2a22-402f-a1b0-a72d17cc7d4d tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:01.246873 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-3ef152ed-2a22-402f-a1b0-a72d17cc7d4d tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:01:01.255626 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-3ef152ed-2a22-402f-a1b0-a72d17cc7d4d tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:01:01.257155 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-3ef152ed-2a22-402f-a1b0-a72d17cc7d4d tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:01:01.258331 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-3ef152ed-2a22-402f-a1b0-a72d17cc7d4d tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5" status: 200 len: 1734 microversion: 2.20 time: 0.174423 Aug 02 11:01:01.258906 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 363/728] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 11:01:01 2022] GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5 => generated 1734 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 11:01:02.103920 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-ab9d7d21-7fc6-430a-bbd4-15f5e5e856d5 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:02.104633 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-ab9d7d21-7fc6-430a-bbd4-15f5e5e856d5 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] [instance: 254a6894-dcb1-4909-a24e-a3a9bf701a83] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:02.112931 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-ab9d7d21-7fc6-430a-bbd4-15f5e5e856d5 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:02.113375 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-ab9d7d21-7fc6-430a-bbd4-15f5e5e856d5 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:02.114147 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-ab9d7d21-7fc6-430a-bbd4-15f5e5e856d5 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:02.114578 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-ab9d7d21-7fc6-430a-bbd4-15f5e5e856d5 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:02.431455 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-ab9d7d21-7fc6-430a-bbd4-15f5e5e856d5 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2664b70cbc1a41a59f78b0b7d4e86643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd54719e5f2b41e6a875361a9188d49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:01:02.439725 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-ab9d7d21-7fc6-430a-bbd4-15f5e5e856d5 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] 10.222.0.115 "GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83" status: 200 len: 1570 microversion: 2.1 time: 0.339666 Aug 02 11:01:02.440336 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 364/729] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:01:02 2022] GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83 => generated 1570 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 11:01:02.445020 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-5670b8fe-ad08-4b16-a15c-37a006c3fe32 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:02.445791 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-5670b8fe-ad08-4b16-a15c-37a006c3fe32 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: f86a8852-12b8-46d3-bd9b-bc140757b4c5] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:02.452744 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-5670b8fe-ad08-4b16-a15c-37a006c3fe32 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:02.453450 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-5670b8fe-ad08-4b16-a15c-37a006c3fe32 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:02.454376 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-5670b8fe-ad08-4b16-a15c-37a006c3fe32 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:02.454816 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-5670b8fe-ad08-4b16-a15c-37a006c3fe32 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:02.595713 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-5670b8fe-ad08-4b16-a15c-37a006c3fe32 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:01:02.603986 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-5670b8fe-ad08-4b16-a15c-37a006c3fe32 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:01:02.605483 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-5670b8fe-ad08-4b16-a15c-37a006c3fe32 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:01:02.606629 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-5670b8fe-ad08-4b16-a15c-37a006c3fe32 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5" status: 200 len: 1734 microversion: 2.20 time: 0.165354 Aug 02 11:01:02.607212 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 365/730] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 11:01:02 2022] GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5 => generated 1734 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 11:01:03.462569 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-0acdc467-52d7-4545-b9f1-ab5b0f2e7571 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:03.463488 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-0acdc467-52d7-4545-b9f1-ab5b0f2e7571 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] [instance: 254a6894-dcb1-4909-a24e-a3a9bf701a83] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:03.469859 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-0acdc467-52d7-4545-b9f1-ab5b0f2e7571 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:03.470387 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-0acdc467-52d7-4545-b9f1-ab5b0f2e7571 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:03.471266 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-0acdc467-52d7-4545-b9f1-ab5b0f2e7571 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:03.471771 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-0acdc467-52d7-4545-b9f1-ab5b0f2e7571 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:03.564525 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-8e45b330-6e59-4dfa-9e3b-e7ea27aa63ee tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] 10.222.0.115 "POST /compute/v2.1/servers/93775f02-e62c-4392-a1ed-cfd5dd956dd7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.674522 Aug 02 11:01:03.565385 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 366/731] 10.222.0.115 () {60 vars in 1328 bytes} [Tue Aug 2 11:00:59 2022] POST /compute/v2.1/servers/93775f02-e62c-4392-a1ed-cfd5dd956dd7/os-volume_attachments => generated 194 bytes in 3676 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 11:01:03.609389 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-0acdc467-52d7-4545-b9f1-ab5b0f2e7571 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2664b70cbc1a41a59f78b0b7d4e86643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd54719e5f2b41e6a875361a9188d49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:01:03.617153 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-0acdc467-52d7-4545-b9f1-ab5b0f2e7571 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] 10.222.0.115 "GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83" status: 200 len: 1570 microversion: 2.1 time: 0.159254 Aug 02 11:01:03.617717 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 366/732] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:01:03 2022] GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83 => generated 1570 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:01:03.631031 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-617b70a5-dc62-4986-9983-92aebb055d92 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:03.631812 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-617b70a5-dc62-4986-9983-92aebb055d92 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: f86a8852-12b8-46d3-bd9b-bc140757b4c5] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:03.638771 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-617b70a5-dc62-4986-9983-92aebb055d92 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:03.639247 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-617b70a5-dc62-4986-9983-92aebb055d92 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:03.640013 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-617b70a5-dc62-4986-9983-92aebb055d92 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:03.640451 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-617b70a5-dc62-4986-9983-92aebb055d92 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:03.777478 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-617b70a5-dc62-4986-9983-92aebb055d92 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:01:03.785587 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-617b70a5-dc62-4986-9983-92aebb055d92 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:01:03.787182 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-617b70a5-dc62-4986-9983-92aebb055d92 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:01:03.788338 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-617b70a5-dc62-4986-9983-92aebb055d92 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5" status: 200 len: 1734 microversion: 2.20 time: 0.162158 Aug 02 11:01:03.788898 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 367/733] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 11:01:03 2022] GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5 => generated 1734 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 11:01:04.034579 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-4a16d4e3-15dd-4ad4-8c20-1f5724c2c0aa tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:04.035001 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-4a16d4e3-15dd-4ad4-8c20-1f5724c2c0aa tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:04.041004 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-4a16d4e3-15dd-4ad4-8c20-1f5724c2c0aa tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:04.044972 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-4a16d4e3-15dd-4ad4-8c20-1f5724c2c0aa tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:04.044972 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-4a16d4e3-15dd-4ad4-8c20-1f5724c2c0aa tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:04.044972 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-4a16d4e3-15dd-4ad4-8c20-1f5724c2c0aa tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:04.125474 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.objects.instance [None req-4a16d4e3-15dd-4ad4-8c20-1f5724c2c0aa tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lazy-loading 'services' on Instance uuid 8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a {{(pid=129952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 11:01:04.385806 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-4a16d4e3-15dd-4ad4-8c20-1f5724c2c0aa tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "DELETE /compute/v2.1/servers/8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a/os-volume_attachments/82f4a931-697f-48ed-9700-45cd2f48f1a1" status: 202 len: 0 microversion: 2.1 time: 0.354703 Aug 02 11:01:04.386418 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 367/734] 10.222.0.115 () {58 vars in 1421 bytes} [Tue Aug 2 11:01:04 2022] DELETE /compute/v2.1/servers/8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a/os-volume_attachments/82f4a931-697f-48ed-9700-45cd2f48f1a1 => generated 0 bytes in 357 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 11:01:04.395098 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-b68f1025-382d-495c-84ee-16cbc7f721bf tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:04.397363 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-b68f1025-382d-495c-84ee-16cbc7f721bf tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:04.404766 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-b68f1025-382d-495c-84ee-16cbc7f721bf tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:04.405230 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-b68f1025-382d-495c-84ee-16cbc7f721bf tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:04.405986 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-b68f1025-382d-495c-84ee-16cbc7f721bf tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:04.406414 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-b68f1025-382d-495c-84ee-16cbc7f721bf tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:04.437089 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-b68f1025-382d-495c-84ee-16cbc7f721bf tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046101 Aug 02 11:01:04.437671 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 368/735] 10.222.0.115 () {58 vars in 1307 bytes} [Tue Aug 2 11:01:04 2022] GET /compute/v2.1/servers/8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 11:01:04.639247 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-d1b59bf3-8661-4a72-a789-ecefbda13df9 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:04.639956 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-d1b59bf3-8661-4a72-a789-ecefbda13df9 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] [instance: 254a6894-dcb1-4909-a24e-a3a9bf701a83] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:04.646371 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-d1b59bf3-8661-4a72-a789-ecefbda13df9 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:04.646822 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-d1b59bf3-8661-4a72-a789-ecefbda13df9 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:04.647623 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-d1b59bf3-8661-4a72-a789-ecefbda13df9 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:04.648067 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-d1b59bf3-8661-4a72-a789-ecefbda13df9 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:04.787145 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-d1b59bf3-8661-4a72-a789-ecefbda13df9 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2664b70cbc1a41a59f78b0b7d4e86643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd54719e5f2b41e6a875361a9188d49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:01:04.795526 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-d1b59bf3-8661-4a72-a789-ecefbda13df9 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] 10.222.0.115 "GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83" status: 200 len: 1570 microversion: 2.1 time: 0.161621 Aug 02 11:01:04.796099 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 368/736] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:01:04 2022] GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83 => generated 1570 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:01:04.812180 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-3984c841-9bcb-4e05-bf57-a46db31660e7 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:04.812780 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-3984c841-9bcb-4e05-bf57-a46db31660e7 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: f86a8852-12b8-46d3-bd9b-bc140757b4c5] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:04.818940 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-3984c841-9bcb-4e05-bf57-a46db31660e7 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:04.819413 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-3984c841-9bcb-4e05-bf57-a46db31660e7 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:04.820175 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-3984c841-9bcb-4e05-bf57-a46db31660e7 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:04.820602 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-3984c841-9bcb-4e05-bf57-a46db31660e7 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:04.972471 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-3984c841-9bcb-4e05-bf57-a46db31660e7 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:01:04.981284 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-3984c841-9bcb-4e05-bf57-a46db31660e7 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:01:04.982843 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-3984c841-9bcb-4e05-bf57-a46db31660e7 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:01:04.984074 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-3984c841-9bcb-4e05-bf57-a46db31660e7 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5" status: 200 len: 1734 microversion: 2.20 time: 0.176039 Aug 02 11:01:04.984647 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 369/737] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 11:01:04 2022] GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5 => generated 1734 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 11:01:05.450000 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-fa99deb9-0a66-4b9b-819b-125a14b23754 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:05.452270 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-fa99deb9-0a66-4b9b-819b-125a14b23754 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:05.458637 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-fa99deb9-0a66-4b9b-819b-125a14b23754 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:05.459104 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-fa99deb9-0a66-4b9b-819b-125a14b23754 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:05.459876 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-fa99deb9-0a66-4b9b-819b-125a14b23754 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:05.460305 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-fa99deb9-0a66-4b9b-819b-125a14b23754 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:05.490736 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-fa99deb9-0a66-4b9b-819b-125a14b23754 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045110 Aug 02 11:01:05.491244 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 369/738] 10.222.0.115 () {58 vars in 1307 bytes} [Tue Aug 2 11:01:05 2022] GET /compute/v2.1/servers/8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 11:01:05.819292 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-3ab9d236-7c87-4e6b-8a2c-e577cc0aa74e tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:05.819905 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-3ab9d236-7c87-4e6b-8a2c-e577cc0aa74e tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] [instance: 254a6894-dcb1-4909-a24e-a3a9bf701a83] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:05.826659 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-3ab9d236-7c87-4e6b-8a2c-e577cc0aa74e tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:05.827156 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-3ab9d236-7c87-4e6b-8a2c-e577cc0aa74e tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:05.827921 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-3ab9d236-7c87-4e6b-8a2c-e577cc0aa74e tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:05.828355 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-3ab9d236-7c87-4e6b-8a2c-e577cc0aa74e tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:05.847119 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG dbcounter [-] [129953] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 11:01:05.968621 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-3ab9d236-7c87-4e6b-8a2c-e577cc0aa74e tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2664b70cbc1a41a59f78b0b7d4e86643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd54719e5f2b41e6a875361a9188d49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:01:05.977048 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-3ab9d236-7c87-4e6b-8a2c-e577cc0aa74e tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] 10.222.0.115 "GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83" status: 200 len: 1570 microversion: 2.1 time: 0.161684 Aug 02 11:01:05.977667 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 370/739] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:01:05 2022] GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83 => generated 1570 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:01:06.007576 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-532549ed-d007-41e9-af29-08faaef80864 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:06.008429 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-532549ed-d007-41e9-af29-08faaef80864 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: f86a8852-12b8-46d3-bd9b-bc140757b4c5] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:06.014807 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-532549ed-d007-41e9-af29-08faaef80864 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:06.015269 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-532549ed-d007-41e9-af29-08faaef80864 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:06.016025 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-532549ed-d007-41e9-af29-08faaef80864 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:06.016454 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-532549ed-d007-41e9-af29-08faaef80864 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:06.153289 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-532549ed-d007-41e9-af29-08faaef80864 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:01:06.162570 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-532549ed-d007-41e9-af29-08faaef80864 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:01:06.164154 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-532549ed-d007-41e9-af29-08faaef80864 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:01:06.165399 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-532549ed-d007-41e9-af29-08faaef80864 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5" status: 200 len: 1734 microversion: 2.20 time: 0.162011 Aug 02 11:01:06.166001 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 370/740] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 11:01:06 2022] GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5 => generated 1734 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 11:01:06.503457 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-e0ba7698-bde1-4b99-9a99-73a9fecf7fb9 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:06.505629 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-e0ba7698-bde1-4b99-9a99-73a9fecf7fb9 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:06.507648 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG dbcounter [-] [129953] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=129953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 11:01:06.515169 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-e0ba7698-bde1-4b99-9a99-73a9fecf7fb9 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:06.515615 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-e0ba7698-bde1-4b99-9a99-73a9fecf7fb9 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:06.516384 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-e0ba7698-bde1-4b99-9a99-73a9fecf7fb9 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:06.516819 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-e0ba7698-bde1-4b99-9a99-73a9fecf7fb9 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:06.547964 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-e0ba7698-bde1-4b99-9a99-73a9fecf7fb9 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048882 Aug 02 11:01:06.548911 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 371/741] 10.222.0.115 () {58 vars in 1307 bytes} [Tue Aug 2 11:01:06 2022] GET /compute/v2.1/servers/8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 11:01:06.999379 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-cd43c886-1a35-4e79-8961-37a25ee92ef5 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:06.999986 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-cd43c886-1a35-4e79-8961-37a25ee92ef5 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] [instance: 254a6894-dcb1-4909-a24e-a3a9bf701a83] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:07.006648 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-cd43c886-1a35-4e79-8961-37a25ee92ef5 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:07.007112 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-cd43c886-1a35-4e79-8961-37a25ee92ef5 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:07.007877 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-cd43c886-1a35-4e79-8961-37a25ee92ef5 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:07.008454 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-cd43c886-1a35-4e79-8961-37a25ee92ef5 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:07.149581 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-cd43c886-1a35-4e79-8961-37a25ee92ef5 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2664b70cbc1a41a59f78b0b7d4e86643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd54719e5f2b41e6a875361a9188d49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:01:07.157893 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-cd43c886-1a35-4e79-8961-37a25ee92ef5 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] 10.222.0.115 "GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83" status: 200 len: 1570 microversion: 2.1 time: 0.162795 Aug 02 11:01:07.158458 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 371/742] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:01:06 2022] GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83 => generated 1570 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:01:07.190252 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-665a56bb-df29-4db3-b94e-eea12a59e658 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:07.190803 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-665a56bb-df29-4db3-b94e-eea12a59e658 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: f86a8852-12b8-46d3-bd9b-bc140757b4c5] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:07.199132 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-665a56bb-df29-4db3-b94e-eea12a59e658 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:07.199789 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-665a56bb-df29-4db3-b94e-eea12a59e658 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:07.200561 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-665a56bb-df29-4db3-b94e-eea12a59e658 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:07.200993 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-665a56bb-df29-4db3-b94e-eea12a59e658 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:07.339521 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-665a56bb-df29-4db3-b94e-eea12a59e658 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:01:07.348065 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-665a56bb-df29-4db3-b94e-eea12a59e658 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:01:07.349563 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-665a56bb-df29-4db3-b94e-eea12a59e658 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:01:07.350902 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-665a56bb-df29-4db3-b94e-eea12a59e658 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5" status: 200 len: 1734 microversion: 2.20 time: 0.165033 Aug 02 11:01:07.351498 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 372/743] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 11:01:07 2022] GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5 => generated 1734 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 11:01:07.560659 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-9bf388d5-9c7d-41f6-a482-d5a5ec3f8e34 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:07.562945 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-9bf388d5-9c7d-41f6-a482-d5a5ec3f8e34 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:07.569242 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-9bf388d5-9c7d-41f6-a482-d5a5ec3f8e34 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:07.569690 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-9bf388d5-9c7d-41f6-a482-d5a5ec3f8e34 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:07.570460 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-9bf388d5-9c7d-41f6-a482-d5a5ec3f8e34 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:07.570895 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-9bf388d5-9c7d-41f6-a482-d5a5ec3f8e34 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:07.585114 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG dbcounter [-] [129952] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=129952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 11:01:07.601979 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-9bf388d5-9c7d-41f6-a482-d5a5ec3f8e34 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046048 Aug 02 11:01:07.602552 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 372/744] 10.222.0.115 () {58 vars in 1307 bytes} [Tue Aug 2 11:01:07 2022] GET /compute/v2.1/servers/8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 11:01:08.182172 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-b3d6742f-48e7-4743-9d37-75c44af907a7 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:08.182584 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-b3d6742f-48e7-4743-9d37-75c44af907a7 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] [instance: 254a6894-dcb1-4909-a24e-a3a9bf701a83] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:08.188660 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-b3d6742f-48e7-4743-9d37-75c44af907a7 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:08.189110 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-b3d6742f-48e7-4743-9d37-75c44af907a7 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:08.189872 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-b3d6742f-48e7-4743-9d37-75c44af907a7 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:08.190308 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-b3d6742f-48e7-4743-9d37-75c44af907a7 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:08.337034 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-b3d6742f-48e7-4743-9d37-75c44af907a7 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2664b70cbc1a41a59f78b0b7d4e86643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd54719e5f2b41e6a875361a9188d49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:01:08.345189 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-b3d6742f-48e7-4743-9d37-75c44af907a7 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] 10.222.0.115 "GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83" status: 200 len: 1511 microversion: 2.1 time: 0.166876 Aug 02 11:01:08.346199 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 373/745] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:01:08 2022] GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83 => generated 1511 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:01:08.365900 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-0834e17a-23b4-40d8-9262-170487617c11 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 11:01:08.367119 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-0834e17a-23b4-40d8-9262-170487617c11 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] [instance: 254a6894-dcb1-4909-a24e-a3a9bf701a83] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:08.374967 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-0834e17a-23b4-40d8-9262-170487617c11 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:08.375721 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-0834e17a-23b4-40d8-9262-170487617c11 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:08.376494 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-0834e17a-23b4-40d8-9262-170487617c11 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:08.376993 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-0834e17a-23b4-40d8-9262-170487617c11 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:08.379474 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-bdada785-c72c-46dc-a97f-3436978484b4 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:08.380161 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-bdada785-c72c-46dc-a97f-3436978484b4 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: f86a8852-12b8-46d3-bd9b-bc140757b4c5] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:08.387798 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-bdada785-c72c-46dc-a97f-3436978484b4 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:08.388343 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-bdada785-c72c-46dc-a97f-3436978484b4 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:08.389198 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-bdada785-c72c-46dc-a97f-3436978484b4 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:08.389703 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-bdada785-c72c-46dc-a97f-3436978484b4 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:08.483512 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-0834e17a-23b4-40d8-9262-170487617c11 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] [instance: 254a6894-dcb1-4909-a24e-a3a9bf701a83] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=129952) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 02 11:01:08.534518 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-bdada785-c72c-46dc-a97f-3436978484b4 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:01:08.542863 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-bdada785-c72c-46dc-a97f-3436978484b4 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:01:08.545935 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-bdada785-c72c-46dc-a97f-3436978484b4 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:01:08.545935 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-bdada785-c72c-46dc-a97f-3436978484b4 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5" status: 200 len: 1734 microversion: 2.20 time: 0.170951 Aug 02 11:01:08.546158 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 374/746] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 11:01:08 2022] GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5 => generated 1734 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 11:01:08.550599 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [req-42afb8d8-480c-4275-a779-5daa7dffcd7e req-1312a0bc-ecd8-48b7-a2ef-512db7e2cda2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f86a8852-12b8-46d3-bd9b-bc140757b4c5", "name": "network-vif-plugged", "status": "completed", "tag": "b19c6f76-3eb2-428e-95c9-247e8c1ea7c5"}]} {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 11:01:08.561043 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [req-42afb8d8-480c-4275-a779-5daa7dffcd7e req-1312a0bc-ecd8-48b7-a2ef-512db7e2cda2 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:08.561488 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [req-42afb8d8-480c-4275-a779-5daa7dffcd7e req-1312a0bc-ecd8-48b7-a2ef-512db7e2cda2 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:08.574045 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.compute.server_external_events [req-42afb8d8-480c-4275-a779-5daa7dffcd7e req-1312a0bc-ecd8-48b7-a2ef-512db7e2cda2 service nova] Creating event network-vif-plugged:b19c6f76-3eb2-428e-95c9-247e8c1ea7c5 for instance f86a8852-12b8-46d3-bd9b-bc140757b4c5 on hv-cinder-85031 Aug 02 11:01:08.580103 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [req-42afb8d8-480c-4275-a779-5daa7dffcd7e req-1312a0bc-ecd8-48b7-a2ef-512db7e2cda2 service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032723 Aug 02 11:01:08.580747 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 375/747] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Aug 2 11:01:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 11:01:08.615153 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-1decde5d-4186-48b4-93de-af6c99a1a018 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:08.617468 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-1decde5d-4186-48b4-93de-af6c99a1a018 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:08.624834 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-1decde5d-4186-48b4-93de-af6c99a1a018 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:08.625291 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-1decde5d-4186-48b4-93de-af6c99a1a018 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:08.626079 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-1decde5d-4186-48b4-93de-af6c99a1a018 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:08.626517 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-1decde5d-4186-48b4-93de-af6c99a1a018 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:08.661740 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-1decde5d-4186-48b4-93de-af6c99a1a018 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051478 Aug 02 11:01:08.662442 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 376/748] 10.222.0.115 () {58 vars in 1307 bytes} [Tue Aug 2 11:01:08 2022] GET /compute/v2.1/servers/8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 11:01:08.800302 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-0834e17a-23b4-40d8-9262-170487617c11 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] 10.222.0.115 "POST /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83/action" status: 202 len: 0 microversion: 2.1 time: 0.438381 Aug 02 11:01:08.801024 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 373/749] 10.222.0.115 () {60 vars in 1283 bytes} [Tue Aug 2 11:01:08 2022] POST /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83/action => generated 0 bytes in 440 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 11:01:08.813656 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-6241e05f-baf4-451e-bc59-f17c36b5f8d8 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:08.814387 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-6241e05f-baf4-451e-bc59-f17c36b5f8d8 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] [instance: 254a6894-dcb1-4909-a24e-a3a9bf701a83] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:08.821485 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-6241e05f-baf4-451e-bc59-f17c36b5f8d8 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:08.821937 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-6241e05f-baf4-451e-bc59-f17c36b5f8d8 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:08.823354 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-6241e05f-baf4-451e-bc59-f17c36b5f8d8 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:08.823805 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-6241e05f-baf4-451e-bc59-f17c36b5f8d8 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:08.974336 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-6241e05f-baf4-451e-bc59-f17c36b5f8d8 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2664b70cbc1a41a59f78b0b7d4e86643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd54719e5f2b41e6a875361a9188d49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:01:08.983138 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-6241e05f-baf4-451e-bc59-f17c36b5f8d8 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] 10.222.0.115 "GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83" status: 200 len: 1519 microversion: 2.1 time: 0.174443 Aug 02 11:01:08.993170 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 377/750] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:01:08 2022] GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83 => generated 1519 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:01:09.569705 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-f7171075-251f-47b7-ba94-e39a06b10b09 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:09.570459 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-f7171075-251f-47b7-ba94-e39a06b10b09 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: f86a8852-12b8-46d3-bd9b-bc140757b4c5] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:09.578259 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-f7171075-251f-47b7-ba94-e39a06b10b09 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:09.578717 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-f7171075-251f-47b7-ba94-e39a06b10b09 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:09.579517 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-f7171075-251f-47b7-ba94-e39a06b10b09 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:09.579957 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-f7171075-251f-47b7-ba94-e39a06b10b09 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:09.676014 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-f6587ca4-417e-4b23-8d85-40b22b2684ea tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:09.678395 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-f6587ca4-417e-4b23-8d85-40b22b2684ea tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:09.685691 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-f6587ca4-417e-4b23-8d85-40b22b2684ea tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:09.686173 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-f6587ca4-417e-4b23-8d85-40b22b2684ea tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:09.686947 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-f6587ca4-417e-4b23-8d85-40b22b2684ea tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:09.687461 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-f6587ca4-417e-4b23-8d85-40b22b2684ea tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:09.719874 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-f6587ca4-417e-4b23-8d85-40b22b2684ea tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048017 Aug 02 11:01:09.720283 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-f7171075-251f-47b7-ba94-e39a06b10b09 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:01:09.724504 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 378/751] 10.222.0.115 () {58 vars in 1307 bytes} [Tue Aug 2 11:01:09 2022] GET /compute/v2.1/servers/8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 11:01:09.730339 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-f7171075-251f-47b7-ba94-e39a06b10b09 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:01:09.731895 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-f7171075-251f-47b7-ba94-e39a06b10b09 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:01:09.733067 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-f7171075-251f-47b7-ba94-e39a06b10b09 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5" status: 200 len: 1734 microversion: 2.20 time: 0.167655 Aug 02 11:01:09.733617 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 374/752] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 11:01:09 2022] GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5 => generated 1734 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 11:01:10.004280 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-e84bf951-0f97-4018-8a55-941e5e511048 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:10.004807 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-e84bf951-0f97-4018-8a55-941e5e511048 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] [instance: 254a6894-dcb1-4909-a24e-a3a9bf701a83] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:10.011328 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-e84bf951-0f97-4018-8a55-941e5e511048 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:10.011872 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-e84bf951-0f97-4018-8a55-941e5e511048 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:10.012639 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-e84bf951-0f97-4018-8a55-941e5e511048 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:10.013100 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-e84bf951-0f97-4018-8a55-941e5e511048 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:10.145052 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-e84bf951-0f97-4018-8a55-941e5e511048 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2664b70cbc1a41a59f78b0b7d4e86643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd54719e5f2b41e6a875361a9188d49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:01:10.154220 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-e84bf951-0f97-4018-8a55-941e5e511048 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] 10.222.0.115 "GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83" status: 200 len: 1519 microversion: 2.1 time: 0.153835 Aug 02 11:01:10.159350 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 379/753] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:01:09 2022] GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83 => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:01:10.595058 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [req-deda5449-0b2a-4c23-b939-4d0006e77b7a req-0aff5a14-c061-409e-bc29-97f249fb74d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "254a6894-dcb1-4909-a24e-a3a9bf701a83", "name": "network-vif-unplugged", "status": "completed", "tag": "950f72fe-d9c4-4546-b649-bf02fe995cd8"}]} {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 11:01:10.605024 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [req-deda5449-0b2a-4c23-b939-4d0006e77b7a req-0aff5a14-c061-409e-bc29-97f249fb74d9 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:10.605457 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [req-deda5449-0b2a-4c23-b939-4d0006e77b7a req-0aff5a14-c061-409e-bc29-97f249fb74d9 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:10.616879 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.compute.server_external_events [req-deda5449-0b2a-4c23-b939-4d0006e77b7a req-0aff5a14-c061-409e-bc29-97f249fb74d9 service nova] Unable to find a host for instance 254a6894-dcb1-4909-a24e-a3a9bf701a83. Dropping event network-vif-unplugged {{(pid=129952) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 02 11:01:10.624386 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [req-deda5449-0b2a-4c23-b939-4d0006e77b7a req-0aff5a14-c061-409e-bc29-97f249fb74d9 service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.026647 Aug 02 11:01:10.624386 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 375/754] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Aug 2 11:01:10 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 28 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 02 11:01:10.732267 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-f16650eb-9a70-4304-b84a-edb361c9b747 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:10.734328 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-f16650eb-9a70-4304-b84a-edb361c9b747 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:10.740894 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-f16650eb-9a70-4304-b84a-edb361c9b747 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:10.741327 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-f16650eb-9a70-4304-b84a-edb361c9b747 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:10.742093 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-f16650eb-9a70-4304-b84a-edb361c9b747 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:10.742517 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-f16650eb-9a70-4304-b84a-edb361c9b747 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:10.757363 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-4767ce2b-1efe-45a7-bc32-d64941185a21 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:10.758127 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-4767ce2b-1efe-45a7-bc32-d64941185a21 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: f86a8852-12b8-46d3-bd9b-bc140757b4c5] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:10.765168 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-4767ce2b-1efe-45a7-bc32-d64941185a21 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:10.765747 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-4767ce2b-1efe-45a7-bc32-d64941185a21 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:10.766624 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-4767ce2b-1efe-45a7-bc32-d64941185a21 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:10.767259 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-4767ce2b-1efe-45a7-bc32-d64941185a21 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:10.773281 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-f16650eb-9a70-4304-b84a-edb361c9b747 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045138 Aug 02 11:01:10.774047 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 380/755] 10.222.0.115 () {58 vars in 1307 bytes} [Tue Aug 2 11:01:10 2022] GET /compute/v2.1/servers/8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 11:01:10.909277 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-4767ce2b-1efe-45a7-bc32-d64941185a21 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:01:10.918521 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-4767ce2b-1efe-45a7-bc32-d64941185a21 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:01:10.920099 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-4767ce2b-1efe-45a7-bc32-d64941185a21 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:01:10.921306 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-4767ce2b-1efe-45a7-bc32-d64941185a21 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5" status: 200 len: 1734 microversion: 2.20 time: 0.168402 Aug 02 11:01:10.921867 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 376/756] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 11:01:10 2022] GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5 => generated 1734 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 11:01:11.175866 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-d2a8a0a7-4908-4493-b322-01313d88260d tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:11.176468 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-d2a8a0a7-4908-4493-b322-01313d88260d tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] [instance: 254a6894-dcb1-4909-a24e-a3a9bf701a83] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:11.183196 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-d2a8a0a7-4908-4493-b322-01313d88260d tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:11.183634 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-d2a8a0a7-4908-4493-b322-01313d88260d tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:11.184381 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-d2a8a0a7-4908-4493-b322-01313d88260d tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:11.184806 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-d2a8a0a7-4908-4493-b322-01313d88260d tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:11.328063 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-d2a8a0a7-4908-4493-b322-01313d88260d tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2664b70cbc1a41a59f78b0b7d4e86643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd54719e5f2b41e6a875361a9188d49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:01:11.338583 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-d2a8a0a7-4908-4493-b322-01313d88260d tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] 10.222.0.115 "GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83" status: 200 len: 1521 microversion: 2.1 time: 0.166052 Aug 02 11:01:11.339175 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 381/757] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:01:11 2022] GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:01:11.786360 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-8baf2877-bc1f-4a0c-a15d-710c167fc366 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:11.788719 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-8baf2877-bc1f-4a0c-a15d-710c167fc366 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:11.795822 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-8baf2877-bc1f-4a0c-a15d-710c167fc366 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:11.796285 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-8baf2877-bc1f-4a0c-a15d-710c167fc366 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:11.797065 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-8baf2877-bc1f-4a0c-a15d-710c167fc366 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:11.797506 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-8baf2877-bc1f-4a0c-a15d-710c167fc366 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:11.833136 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-8baf2877-bc1f-4a0c-a15d-710c167fc366 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050828 Aug 02 11:01:11.833809 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 377/758] 10.222.0.115 () {58 vars in 1307 bytes} [Tue Aug 2 11:01:11 2022] GET /compute/v2.1/servers/8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 11:01:11.945142 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-be45e662-6cc0-4cf6-9deb-5e78cb0d4ba7 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:11.945783 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-be45e662-6cc0-4cf6-9deb-5e78cb0d4ba7 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: f86a8852-12b8-46d3-bd9b-bc140757b4c5] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:11.953004 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-be45e662-6cc0-4cf6-9deb-5e78cb0d4ba7 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:11.953532 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-be45e662-6cc0-4cf6-9deb-5e78cb0d4ba7 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:11.954310 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-be45e662-6cc0-4cf6-9deb-5e78cb0d4ba7 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:11.954855 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-be45e662-6cc0-4cf6-9deb-5e78cb0d4ba7 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:12.093553 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-be45e662-6cc0-4cf6-9deb-5e78cb0d4ba7 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:01:12.101614 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-be45e662-6cc0-4cf6-9deb-5e78cb0d4ba7 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:01:12.103205 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-be45e662-6cc0-4cf6-9deb-5e78cb0d4ba7 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:01:12.104474 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-be45e662-6cc0-4cf6-9deb-5e78cb0d4ba7 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5" status: 200 len: 1734 microversion: 2.20 time: 0.163345 Aug 02 11:01:12.105037 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 382/759] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 11:01:11 2022] GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5 => generated 1734 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 11:01:12.359756 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-9bd4331e-3f5a-4ac1-858b-ce8a7c8c89e6 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:12.360280 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-9bd4331e-3f5a-4ac1-858b-ce8a7c8c89e6 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] [instance: 254a6894-dcb1-4909-a24e-a3a9bf701a83] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:12.362135 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG dbcounter [-] [129952] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1 {{(pid=129952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 11:01:12.366927 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-9bd4331e-3f5a-4ac1-858b-ce8a7c8c89e6 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:12.367403 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-9bd4331e-3f5a-4ac1-858b-ce8a7c8c89e6 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:12.368167 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-9bd4331e-3f5a-4ac1-858b-ce8a7c8c89e6 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:12.368810 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-9bd4331e-3f5a-4ac1-858b-ce8a7c8c89e6 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:12.502533 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-9bd4331e-3f5a-4ac1-858b-ce8a7c8c89e6 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2664b70cbc1a41a59f78b0b7d4e86643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd54719e5f2b41e6a875361a9188d49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:01:12.510581 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-9bd4331e-3f5a-4ac1-858b-ce8a7c8c89e6 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] 10.222.0.115 "GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83" status: 200 len: 1521 microversion: 2.1 time: 0.154785 Aug 02 11:01:12.511182 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 378/760] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:01:12 2022] GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:01:12.845713 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-80c3036a-0e9c-485d-b2be-6084d6101648 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:12.847930 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-80c3036a-0e9c-485d-b2be-6084d6101648 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:12.854743 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-80c3036a-0e9c-485d-b2be-6084d6101648 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:12.855227 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-80c3036a-0e9c-485d-b2be-6084d6101648 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:12.855994 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-80c3036a-0e9c-485d-b2be-6084d6101648 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:12.856429 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-80c3036a-0e9c-485d-b2be-6084d6101648 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:12.888899 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-80c3036a-0e9c-485d-b2be-6084d6101648 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046670 Aug 02 11:01:12.889485 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 383/761] 10.222.0.115 () {58 vars in 1307 bytes} [Tue Aug 2 11:01:12 2022] GET /compute/v2.1/servers/8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 11:01:13.128282 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-c8fd0c00-3314-43e6-add7-670765c5147d tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:13.128809 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-c8fd0c00-3314-43e6-add7-670765c5147d tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: f86a8852-12b8-46d3-bd9b-bc140757b4c5] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:13.135409 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-c8fd0c00-3314-43e6-add7-670765c5147d tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:13.135856 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-c8fd0c00-3314-43e6-add7-670765c5147d tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:13.136707 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-c8fd0c00-3314-43e6-add7-670765c5147d tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:13.137132 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-c8fd0c00-3314-43e6-add7-670765c5147d tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:13.273489 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-c8fd0c00-3314-43e6-add7-670765c5147d tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:01:13.281845 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-c8fd0c00-3314-43e6-add7-670765c5147d tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:01:13.283359 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-c8fd0c00-3314-43e6-add7-670765c5147d tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:01:13.284514 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-c8fd0c00-3314-43e6-add7-670765c5147d tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5" status: 200 len: 1721 microversion: 2.20 time: 0.160242 Aug 02 11:01:13.285071 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 379/762] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 11:01:13 2022] GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 11:01:13.532828 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-3fbf2a15-66b6-4922-8bf9-df8c4460fa47 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:13.533432 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-3fbf2a15-66b6-4922-8bf9-df8c4460fa47 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] [instance: 254a6894-dcb1-4909-a24e-a3a9bf701a83] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:13.540000 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-3fbf2a15-66b6-4922-8bf9-df8c4460fa47 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:13.541450 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-3fbf2a15-66b6-4922-8bf9-df8c4460fa47 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:13.541927 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-3fbf2a15-66b6-4922-8bf9-df8c4460fa47 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:13.542356 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-3fbf2a15-66b6-4922-8bf9-df8c4460fa47 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:13.687239 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-3fbf2a15-66b6-4922-8bf9-df8c4460fa47 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2664b70cbc1a41a59f78b0b7d4e86643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd54719e5f2b41e6a875361a9188d49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:01:13.695103 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-3fbf2a15-66b6-4922-8bf9-df8c4460fa47 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] 10.222.0.115 "GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83" status: 200 len: 1521 microversion: 2.1 time: 0.166137 Aug 02 11:01:13.695675 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 384/763] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:01:13 2022] GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:01:13.763864 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-3d4f57b3-3ffa-4672-a933-ad4c39e4a9ad tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:13.766167 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-3d4f57b3-3ffa-4672-a933-ad4c39e4a9ad tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] [instance: 93775f02-e62c-4392-a1ed-cfd5dd956dd7] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:13.773023 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-3d4f57b3-3ffa-4672-a933-ad4c39e4a9ad tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:13.773559 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-3d4f57b3-3ffa-4672-a933-ad4c39e4a9ad tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:13.774410 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-3d4f57b3-3ffa-4672-a933-ad4c39e4a9ad tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:13.774939 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-3d4f57b3-3ffa-4672-a933-ad4c39e4a9ad tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:13.808930 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-3d4f57b3-3ffa-4672-a933-ad4c39e4a9ad tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] 10.222.0.115 "GET /compute/v2.1/servers/93775f02-e62c-4392-a1ed-cfd5dd956dd7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049161 Aug 02 11:01:13.809824 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 380/764] 10.222.0.115 () {58 vars in 1307 bytes} [Tue Aug 2 11:01:13 2022] GET /compute/v2.1/servers/93775f02-e62c-4392-a1ed-cfd5dd956dd7/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 11:01:13.820295 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-08766fcd-145f-4040-a0e2-fa7adc01a800 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:13.820818 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-08766fcd-145f-4040-a0e2-fa7adc01a800 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] [instance: 93775f02-e62c-4392-a1ed-cfd5dd956dd7] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:13.827112 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-08766fcd-145f-4040-a0e2-fa7adc01a800 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:13.827561 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-08766fcd-145f-4040-a0e2-fa7adc01a800 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:13.828320 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-08766fcd-145f-4040-a0e2-fa7adc01a800 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:13.828779 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-08766fcd-145f-4040-a0e2-fa7adc01a800 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:13.861992 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-08766fcd-145f-4040-a0e2-fa7adc01a800 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] 10.222.0.115 "GET /compute/v2.1/servers/93775f02-e62c-4392-a1ed-cfd5dd956dd7/os-volume_attachments/9f6e0b60-47e6-4d48-a6ca-f0a4482f30af" status: 200 len: 194 microversion: 2.1 time: 0.045542 Aug 02 11:01:13.861992 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 385/765] 10.222.0.115 () {58 vars in 1418 bytes} [Tue Aug 2 11:01:13 2022] GET /compute/v2.1/servers/93775f02-e62c-4392-a1ed-cfd5dd956dd7/os-volume_attachments/9f6e0b60-47e6-4d48-a6ca-f0a4482f30af => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 11:01:13.903209 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-c9195ef2-5065-4c5f-ac21-ed00c49b387b tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:13.905364 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-c9195ef2-5065-4c5f-ac21-ed00c49b387b tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:13.911638 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-c9195ef2-5065-4c5f-ac21-ed00c49b387b tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:13.912174 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-c9195ef2-5065-4c5f-ac21-ed00c49b387b tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:13.913020 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-c9195ef2-5065-4c5f-ac21-ed00c49b387b tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:13.913362 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-c9195ef2-5065-4c5f-ac21-ed00c49b387b tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:13.949972 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-c9195ef2-5065-4c5f-ac21-ed00c49b387b tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052496 Aug 02 11:01:13.950906 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 381/766] 10.222.0.115 () {58 vars in 1307 bytes} [Tue Aug 2 11:01:13 2022] GET /compute/v2.1/servers/8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 11:01:14.465564 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-d5adc460-14ce-495b-b131-71f6d97b911c tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:14.466141 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-d5adc460-14ce-495b-b131-71f6d97b911c tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:14.486806 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-d5adc460-14ce-495b-b131-71f6d97b911c tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:14.487297 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-d5adc460-14ce-495b-b131-71f6d97b911c tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:14.488088 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-d5adc460-14ce-495b-b131-71f6d97b911c tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:14.488523 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-d5adc460-14ce-495b-b131-71f6d97b911c tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:14.532572 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-d5adc460-14ce-495b-b131-71f6d97b911c tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a] Going to try to terminate instance {{(pid=129953) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 11:01:14.578480 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG dbcounter [-] [129953] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=129953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 11:01:14.717183 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-3ebb9e8d-7c03-4abb-8aa7-da7fce1ef30a tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:14.717792 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-3ebb9e8d-7c03-4abb-8aa7-da7fce1ef30a tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] [instance: 254a6894-dcb1-4909-a24e-a3a9bf701a83] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:14.726764 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-3ebb9e8d-7c03-4abb-8aa7-da7fce1ef30a tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:14.727437 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-3ebb9e8d-7c03-4abb-8aa7-da7fce1ef30a tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:14.728657 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-3ebb9e8d-7c03-4abb-8aa7-da7fce1ef30a tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:14.729199 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-3ebb9e8d-7c03-4abb-8aa7-da7fce1ef30a tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:14.814525 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-d5adc460-14ce-495b-b131-71f6d97b911c tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "DELETE /compute/v2.1/servers/8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a" status: 204 len: 0 microversion: 2.1 time: 0.354275 Aug 02 11:01:14.815264 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 386/767] 10.222.0.115 () {58 vars in 1244 bytes} [Tue Aug 2 11:01:14 2022] DELETE /compute/v2.1/servers/8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a => generated 0 bytes in 356 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 02 11:01:14.824394 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-751a14b1-b2c1-40e7-a64f-aef873d45d97 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:14.825168 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-751a14b1-b2c1-40e7-a64f-aef873d45d97 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:14.831439 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-751a14b1-b2c1-40e7-a64f-aef873d45d97 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:14.831889 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-751a14b1-b2c1-40e7-a64f-aef873d45d97 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:14.832712 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-751a14b1-b2c1-40e7-a64f-aef873d45d97 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:14.833209 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-751a14b1-b2c1-40e7-a64f-aef873d45d97 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:14.888371 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-3ebb9e8d-7c03-4abb-8aa7-da7fce1ef30a tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2664b70cbc1a41a59f78b0b7d4e86643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd54719e5f2b41e6a875361a9188d49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:01:14.896083 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-3ebb9e8d-7c03-4abb-8aa7-da7fce1ef30a tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] 10.222.0.115 "GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83" status: 200 len: 1521 microversion: 2.1 time: 0.183635 Aug 02 11:01:14.896732 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 382/768] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:01:14 2022] GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83 => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 11:01:14.976486 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-751a14b1-b2c1-40e7-a64f-aef873d45d97 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:01:14.984289 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-751a14b1-b2c1-40e7-a64f-aef873d45d97 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a" status: 200 len: 1694 microversion: 2.1 time: 0.164987 Aug 02 11:01:14.984858 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 387/769] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:01:14 2022] GET /compute/v2.1/servers/8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a => generated 1694 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:01:15.539350 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-76b63f69-bdf9-4f49-bbe7-03d64936ae0b tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4cf32135-1022-4abf-83f5-94139c1da0e7"}} {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 11:01:15.542461 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-76b63f69-bdf9-4f49-bbe7-03d64936ae0b tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] [instance: 93775f02-e62c-4392-a1ed-cfd5dd956dd7] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:15.548461 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-76b63f69-bdf9-4f49-bbe7-03d64936ae0b tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:15.548902 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-76b63f69-bdf9-4f49-bbe7-03d64936ae0b tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:15.549652 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-76b63f69-bdf9-4f49-bbe7-03d64936ae0b tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:15.550077 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-76b63f69-bdf9-4f49-bbe7-03d64936ae0b tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:15.918575 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-5b81db0c-58eb-4390-9131-a8524c68c5a8 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:15.919244 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-5b81db0c-58eb-4390-9131-a8524c68c5a8 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] [instance: 254a6894-dcb1-4909-a24e-a3a9bf701a83] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:15.925797 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-5b81db0c-58eb-4390-9131-a8524c68c5a8 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:15.926241 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-5b81db0c-58eb-4390-9131-a8524c68c5a8 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:15.926998 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-5b81db0c-58eb-4390-9131-a8524c68c5a8 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:15.927450 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-5b81db0c-58eb-4390-9131-a8524c68c5a8 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:16.056615 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-5b81db0c-58eb-4390-9131-a8524c68c5a8 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2664b70cbc1a41a59f78b0b7d4e86643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd54719e5f2b41e6a875361a9188d49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:01:16.064196 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-5b81db0c-58eb-4390-9131-a8524c68c5a8 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] 10.222.0.115 "GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83" status: 200 len: 1521 microversion: 2.1 time: 0.150293 Aug 02 11:01:16.064746 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 388/770] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:01:15 2022] GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 11:01:16.069047 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-501e3c0c-5440-447e-8e00-fb209268df8c tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:16.069639 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-501e3c0c-5440-447e-8e00-fb209268df8c tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:16.075319 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-501e3c0c-5440-447e-8e00-fb209268df8c tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:16.075792 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-501e3c0c-5440-447e-8e00-fb209268df8c tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:16.076544 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-501e3c0c-5440-447e-8e00-fb209268df8c tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:16.076971 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-501e3c0c-5440-447e-8e00-fb209268df8c tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:16.205387 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-501e3c0c-5440-447e-8e00-fb209268df8c tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:01:16.213544 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-501e3c0c-5440-447e-8e00-fb209268df8c tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a" status: 200 len: 1694 microversion: 2.1 time: 0.147234 Aug 02 11:01:16.214124 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 389/771] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:01:16 2022] GET /compute/v2.1/servers/8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a => generated 1694 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:01:17.085260 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-063c4d01-983d-4a04-9f94-b840cb246146 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:17.085858 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-063c4d01-983d-4a04-9f94-b840cb246146 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] [instance: 254a6894-dcb1-4909-a24e-a3a9bf701a83] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:17.092696 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-063c4d01-983d-4a04-9f94-b840cb246146 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:17.093146 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-063c4d01-983d-4a04-9f94-b840cb246146 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:17.093914 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-063c4d01-983d-4a04-9f94-b840cb246146 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:17.094345 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-063c4d01-983d-4a04-9f94-b840cb246146 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:17.232924 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-063c4d01-983d-4a04-9f94-b840cb246146 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2664b70cbc1a41a59f78b0b7d4e86643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd54719e5f2b41e6a875361a9188d49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:01:17.240632 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-063c4d01-983d-4a04-9f94-b840cb246146 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] 10.222.0.115 "GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83" status: 200 len: 1521 microversion: 2.1 time: 0.159299 Aug 02 11:01:17.241193 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 390/772] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:01:17 2022] GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 11:01:17.246320 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-37e51958-07d5-4c10-9f64-c136714ba29e tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:17.246914 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-37e51958-07d5-4c10-9f64-c136714ba29e tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:17.252936 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-37e51958-07d5-4c10-9f64-c136714ba29e tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:17.253385 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-37e51958-07d5-4c10-9f64-c136714ba29e tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:17.254188 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-37e51958-07d5-4c10-9f64-c136714ba29e tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:17.254624 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-37e51958-07d5-4c10-9f64-c136714ba29e tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:17.386823 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-37e51958-07d5-4c10-9f64-c136714ba29e tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:01:17.394401 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-37e51958-07d5-4c10-9f64-c136714ba29e tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a" status: 200 len: 1694 microversion: 2.1 time: 0.152268 Aug 02 11:01:17.394988 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 391/773] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:01:17 2022] GET /compute/v2.1/servers/8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a => generated 1694 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:01:18.262717 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-92cd6a22-d0f6-4556-bf24-b3d4d1b03ce7 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:18.263451 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-92cd6a22-d0f6-4556-bf24-b3d4d1b03ce7 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] [instance: 254a6894-dcb1-4909-a24e-a3a9bf701a83] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:18.270509 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-92cd6a22-d0f6-4556-bf24-b3d4d1b03ce7 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:18.270509 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-92cd6a22-d0f6-4556-bf24-b3d4d1b03ce7 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:18.271200 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-92cd6a22-d0f6-4556-bf24-b3d4d1b03ce7 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:18.271641 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-92cd6a22-d0f6-4556-bf24-b3d4d1b03ce7 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:18.414291 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-92cd6a22-d0f6-4556-bf24-b3d4d1b03ce7 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2664b70cbc1a41a59f78b0b7d4e86643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd54719e5f2b41e6a875361a9188d49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:01:18.429075 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-92cd6a22-d0f6-4556-bf24-b3d4d1b03ce7 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] 10.222.0.115 "GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83" status: 200 len: 1521 microversion: 2.1 time: 0.170038 Aug 02 11:01:18.431287 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 392/774] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:01:18 2022] GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 11:01:18.438797 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-ee5b9efa-29b2-42f5-b252-30bb989810e5 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:18.439584 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-ee5b9efa-29b2-42f5-b252-30bb989810e5 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:18.449847 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-ee5b9efa-29b2-42f5-b252-30bb989810e5 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:18.450661 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-ee5b9efa-29b2-42f5-b252-30bb989810e5 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:18.451961 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-ee5b9efa-29b2-42f5-b252-30bb989810e5 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:18.452672 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-ee5b9efa-29b2-42f5-b252-30bb989810e5 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:18.610585 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-ee5b9efa-29b2-42f5-b252-30bb989810e5 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:01:18.618267 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-ee5b9efa-29b2-42f5-b252-30bb989810e5 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a" status: 200 len: 1694 microversion: 2.1 time: 0.185515 Aug 02 11:01:18.618852 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 393/775] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:01:18 2022] GET /compute/v2.1/servers/8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a => generated 1694 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:01:18.910631 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-76b63f69-bdf9-4f49-bbe7-03d64936ae0b tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] 10.222.0.115 "POST /compute/v2.1/servers/93775f02-e62c-4392-a1ed-cfd5dd956dd7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.374848 Aug 02 11:01:18.917924 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 383/776] 10.222.0.115 () {60 vars in 1328 bytes} [Tue Aug 2 11:01:15 2022] POST /compute/v2.1/servers/93775f02-e62c-4392-a1ed-cfd5dd956dd7/os-volume_attachments => generated 194 bytes in 3377 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 11:01:19.448715 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [req-5a87c792-2d62-4ebb-a25e-bd94edd5111c req-fc97ee93-e002-4b38-934e-58910049b7cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a", "name": "network-vif-deleted", "tag": "83daf3e6-2460-4c6a-8114-303f93cdd38a"}]} {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 11:01:19.455509 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-60403ac4-6469-4a2c-be4e-b2413249408d tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:19.456535 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-60403ac4-6469-4a2c-be4e-b2413249408d tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] [instance: 254a6894-dcb1-4909-a24e-a3a9bf701a83] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:19.464984 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [req-5a87c792-2d62-4ebb-a25e-bd94edd5111c req-fc97ee93-e002-4b38-934e-58910049b7cd service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:19.465880 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-60403ac4-6469-4a2c-be4e-b2413249408d tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:19.465969 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [req-5a87c792-2d62-4ebb-a25e-bd94edd5111c req-fc97ee93-e002-4b38-934e-58910049b7cd service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:19.466066 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-60403ac4-6469-4a2c-be4e-b2413249408d tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:19.466066 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-60403ac4-6469-4a2c-be4e-b2413249408d tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:19.466066 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-60403ac4-6469-4a2c-be4e-b2413249408d tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:19.485169 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.compute.server_external_events [req-5a87c792-2d62-4ebb-a25e-bd94edd5111c req-fc97ee93-e002-4b38-934e-58910049b7cd service nova] Creating event network-vif-deleted:83daf3e6-2460-4c6a-8114-303f93cdd38a for instance 8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a on hv-cinder-85031 Aug 02 11:01:19.491113 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [req-5a87c792-2d62-4ebb-a25e-bd94edd5111c req-fc97ee93-e002-4b38-934e-58910049b7cd service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053925 Aug 02 11:01:19.492842 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 394/777] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Aug 2 11:01:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 11:01:19.647096 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-562a42a0-b981-497d-9d91-8a8b7caafbd9 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:19.648182 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-562a42a0-b981-497d-9d91-8a8b7caafbd9 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:19.658929 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-60403ac4-6469-4a2c-be4e-b2413249408d tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2664b70cbc1a41a59f78b0b7d4e86643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd54719e5f2b41e6a875361a9188d49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:01:19.662477 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-562a42a0-b981-497d-9d91-8a8b7caafbd9 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:19.663395 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-562a42a0-b981-497d-9d91-8a8b7caafbd9 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:19.666252 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-562a42a0-b981-497d-9d91-8a8b7caafbd9 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:19.666849 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-562a42a0-b981-497d-9d91-8a8b7caafbd9 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:19.670321 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-60403ac4-6469-4a2c-be4e-b2413249408d tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] 10.222.0.115 "GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83" status: 200 len: 1577 microversion: 2.1 time: 0.219311 Aug 02 11:01:19.671422 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 384/778] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:01:19 2022] GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83 => generated 1577 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 11:01:19.745742 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-562a42a0-b981-497d-9d91-8a8b7caafbd9 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:01:19.753728 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-562a42a0-b981-497d-9d91-8a8b7caafbd9 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a" status: 200 len: 1335 microversion: 2.1 time: 0.116408 Aug 02 11:01:19.754351 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 395/779] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:01:19 2022] GET /compute/v2.1/servers/8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a => generated 1335 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 11:01:19.786099 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-4146bf75-bd04-402f-9677-8b6b36b78a61 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:19.786679 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-4146bf75-bd04-402f-9677-8b6b36b78a61 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: 07d63415-e151-4b2f-93ff-0769c401f16b] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:19.794982 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-4146bf75-bd04-402f-9677-8b6b36b78a61 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:19.799344 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-4146bf75-bd04-402f-9677-8b6b36b78a61 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:19.799344 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-4146bf75-bd04-402f-9677-8b6b36b78a61 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:19.799344 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-4146bf75-bd04-402f-9677-8b6b36b78a61 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:19.825141 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-4146bf75-bd04-402f-9677-8b6b36b78a61 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "GET /compute/v2.1/servers/07d63415-e151-4b2f-93ff-0769c401f16b/ips" status: 200 len: 151 microversion: 2.1 time: 0.042822 Aug 02 11:01:19.833369 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 385/780] 10.222.0.115 () {58 vars in 1253 bytes} [Tue Aug 2 11:01:19 2022] GET /compute/v2.1/servers/07d63415-e151-4b2f-93ff-0769c401f16b/ips => generated 151 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 11:01:20.692303 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-e2051abb-b6ea-4831-bd23-2374802ff8ec tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:20.693536 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-e2051abb-b6ea-4831-bd23-2374802ff8ec tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] [instance: 254a6894-dcb1-4909-a24e-a3a9bf701a83] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:20.700524 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-e2051abb-b6ea-4831-bd23-2374802ff8ec tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:20.700955 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-e2051abb-b6ea-4831-bd23-2374802ff8ec tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:20.701718 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-e2051abb-b6ea-4831-bd23-2374802ff8ec tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:20.702151 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-e2051abb-b6ea-4831-bd23-2374802ff8ec tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:20.836797 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-cc0bfd8e-9ced-48b8-b6b2-8caf42171378 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:20.837745 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-cc0bfd8e-9ced-48b8-b6b2-8caf42171378 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:20.845201 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-cc0bfd8e-9ced-48b8-b6b2-8caf42171378 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:20.845614 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-cc0bfd8e-9ced-48b8-b6b2-8caf42171378 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:20.846765 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-cc0bfd8e-9ced-48b8-b6b2-8caf42171378 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:20.847242 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-cc0bfd8e-9ced-48b8-b6b2-8caf42171378 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:20.848219 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-e2051abb-b6ea-4831-bd23-2374802ff8ec tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2664b70cbc1a41a59f78b0b7d4e86643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd54719e5f2b41e6a875361a9188d49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:01:20.859436 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-e2051abb-b6ea-4831-bd23-2374802ff8ec tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] 10.222.0.115 "GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83" status: 200 len: 1577 microversion: 2.1 time: 0.171185 Aug 02 11:01:20.860076 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 396/781] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:01:20 2022] GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83 => generated 1577 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:01:20.870051 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.wsgi [None req-cc0bfd8e-9ced-48b8-b6b2-8caf42171378 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] HTTP exception thrown: Instance 8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a could not be found. Aug 02 11:01:20.870051 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-cc0bfd8e-9ced-48b8-b6b2-8caf42171378 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Request method failure captured: Aug 02 11:01:20.870051 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: request: GET /compute/v2.1/servers/8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a HTTP/1.1 Aug 02 11:01:20.870051 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Accept: application/json Aug 02 11:01:20.870051 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Accept-Encoding: identity Aug 02 11:01:20.870051 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Connection: close Aug 02 11:01:20.870051 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Content-Length: 0 Aug 02 11:01:20.870051 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Content-Type: application/json Aug 02 11:01:20.870051 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Host: 10.222.0.115 Aug 02 11:01:20.870051 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Openstack-System-Scope: None Aug 02 11:01:20.870051 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: User-Agent: python-urllib3/1.26.10 Aug 02 11:01:20.870051 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Auth-Token: gAAAAABi6QLU4-kFVceoHWEpo94bbvBf1uqlEx4Gmz_ix8LIhs0hb3WYrUk_oMQ3oj3o3ZEWUh1MDl3j04cDaiOxlt6Nmx19h9H9o9YzMFcctjtmr66KQ4MTn2pZ5x6hWud4Dyg2XcQVpsrwtFErHKVVnsJz6A5M7HawuEHdbt-qhQJOR6Lin2k Aug 02 11:01:20.870051 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Domain-Id: None Aug 02 11:01:20.870051 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Domain-Name: None Aug 02 11:01:20.870051 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Identity-Status: Confirmed Aug 02 11:01:20.870051 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Is-Admin-Project: True Aug 02 11:01:20.870051 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Project-Domain-Id: default Aug 02 11:01:20.870051 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Project-Domain-Name: Default Aug 02 11:01:20.870051 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Project-Id: 0d99d3fd13df429a8ee8a7cb7780adb5 Aug 02 11:01:20.870051 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1563347873 Aug 02 11:01:20.870051 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Role: reader,member Aug 02 11:01:20.870051 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Roles: reader,member Aug 02 11:01:20.872415 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/0d99d3fd13df429a8ee8a7cb7780adb5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2/0d99d3fd13df429a8ee8a7cb7780adb5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/0d99d3fd13df429a8ee8a7cb7780adb5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.115:8080", "publicURL": "http://10.222.0.115:8080/v1/AUTH_0d99d3fd13df429a8ee8a7cb7780adb5"}]}] Aug 02 11:01:20.872415 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1563347873 Aug 02 11:01:20.872415 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Tenant-Id: 0d99d3fd13df429a8ee8a7cb7780adb5 Aug 02 11:01:20.872415 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1563347873 Aug 02 11:01:20.872415 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User: tempest-ServerRescueNegativeTestJSON-1563347873-project Aug 02 11:01:20.872415 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User-Domain-Id: default Aug 02 11:01:20.872415 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User-Domain-Name: Default Aug 02 11:01:20.872415 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User-Id: 3057a53debc34c829372c03567e1119d Aug 02 11:01:20.872415 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1563347873-project Aug 02 11:01:20.872415 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: method: > Aug 02 11:01:20.872415 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: exception: Instance 8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a could not be found. Aug 02 11:01:20.872415 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: action_args: {'id': '8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a'} Aug 02 11:01:20.873348 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 11:01:20.873348 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:01:20.873348 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 11:01:20.873348 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 11:01:20.873348 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 11:01:20.873348 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 11:01:20.873348 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 11:01:20.873348 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 11:01:20.873348 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 11:01:20.873348 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 11:01:20.873348 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a could not be found. Aug 02 11:01:20.873348 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 11:01:20.873348 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 11:01:20.873348 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 11:01:20.873348 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:01:20.873348 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 11:01:20.873348 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 11:01:20.873348 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 11:01:20.873348 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 11:01:20.873348 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 11:01:20.874898 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 11:01:20.874898 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 11:01:20.874898 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 11:01:20.874898 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 11:01:20.874898 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 11:01:20.874898 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 11:01:20.874898 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 11:01:20.874898 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a could not be found. Aug 02 11:01:20.874898 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 11:01:20.874898 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 11:01:20.874898 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 11:01:20.874898 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:01:20.874898 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 11:01:20.874898 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 11:01:20.874898 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 11:01:20.874898 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 11:01:20.874898 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a could not be found. Aug 02 11:01:20.874898 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 11:01:20.879873 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-cc0bfd8e-9ced-48b8-b6b2-8caf42171378 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Returning 404 to user: Instance 8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a could not be found. {{(pid=129952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 11:01:20.879873 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-cc0bfd8e-9ced-48b8-b6b2-8caf42171378 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a" status: 404 len: 111 microversion: 2.1 time: 0.097364 Aug 02 11:01:20.879873 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 386/782] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:01:20 2022] GET /compute/v2.1/servers/8c67a5ba-0d66-48ad-ad03-4a7226bbcb3a => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 02 11:01:20.880102 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-46f38ff3-2cb8-4e73-9f2c-73b621beee9b tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '.version_select at 0x7f7c576f4160>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:21.001208 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-46f38ff3-2cb8-4e73-9f2c-73b621beee9b tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1403777949" status: 202 len: 0 microversion: 2.1 time: 0.127396 Aug 02 11:01:21.001801 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 397/783] 10.222.0.115 () {58 vars in 1226 bytes} [Tue Aug 2 11:01:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1403777949 => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 02 11:01:21.485363 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-260d8823-baef-458b-b77f-288919acb829 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d74fb775-1648-4215-ad4f-a52ec636ae1d"}} {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 11:01:21.488173 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-260d8823-baef-458b-b77f-288919acb829 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: 07d63415-e151-4b2f-93ff-0769c401f16b] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:21.494341 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-260d8823-baef-458b-b77f-288919acb829 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:21.494947 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-260d8823-baef-458b-b77f-288919acb829 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:21.495745 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-260d8823-baef-458b-b77f-288919acb829 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:21.496181 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-260d8823-baef-458b-b77f-288919acb829 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:21.721663 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG dbcounter [-] [129952] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=129952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 11:01:21.885839 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-f7adf5ef-512c-428b-961d-8bd94b0e6b09 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:21.886477 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-f7adf5ef-512c-428b-961d-8bd94b0e6b09 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] [instance: 254a6894-dcb1-4909-a24e-a3a9bf701a83] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:21.892996 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-f7adf5ef-512c-428b-961d-8bd94b0e6b09 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:21.893837 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-f7adf5ef-512c-428b-961d-8bd94b0e6b09 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:21.894345 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-f7adf5ef-512c-428b-961d-8bd94b0e6b09 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:21.894800 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-f7adf5ef-512c-428b-961d-8bd94b0e6b09 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:22.033278 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-f7adf5ef-512c-428b-961d-8bd94b0e6b09 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2664b70cbc1a41a59f78b0b7d4e86643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd54719e5f2b41e6a875361a9188d49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:01:22.041402 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-f7adf5ef-512c-428b-961d-8bd94b0e6b09 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] 10.222.0.115 "GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83" status: 200 len: 1577 microversion: 2.1 time: 0.159380 Aug 02 11:01:22.042944 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 398/784] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:01:21 2022] GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83 => generated 1577 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 11:01:22.301607 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-260d8823-baef-458b-b77f-288919acb829 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "POST /compute/v2.1/servers/07d63415-e151-4b2f-93ff-0769c401f16b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.820004 Aug 02 11:01:22.302292 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 387/785] 10.222.0.115 () {60 vars in 1328 bytes} [Tue Aug 2 11:01:21 2022] POST /compute/v2.1/servers/07d63415-e151-4b2f-93ff-0769c401f16b/os-volume_attachments => generated 194 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 11:01:23.067745 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-2384d7bb-27d6-40d8-b988-905e17ec3267 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:23.067745 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-2384d7bb-27d6-40d8-b988-905e17ec3267 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] [instance: 254a6894-dcb1-4909-a24e-a3a9bf701a83] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:23.080420 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-2384d7bb-27d6-40d8-b988-905e17ec3267 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:23.081111 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-2384d7bb-27d6-40d8-b988-905e17ec3267 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:23.082318 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-2384d7bb-27d6-40d8-b988-905e17ec3267 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:23.083001 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-2384d7bb-27d6-40d8-b988-905e17ec3267 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:23.238885 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-2384d7bb-27d6-40d8-b988-905e17ec3267 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2664b70cbc1a41a59f78b0b7d4e86643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd54719e5f2b41e6a875361a9188d49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:01:23.247658 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-2384d7bb-27d6-40d8-b988-905e17ec3267 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] 10.222.0.115 "GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83" status: 200 len: 1577 microversion: 2.1 time: 0.187383 Aug 02 11:01:23.248244 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 399/786] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:01:23 2022] GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83 => generated 1577 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:01:24.271027 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-4ba86dd1-ce0b-46b5-8c33-cb4a8c2875f9 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:24.272113 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-4ba86dd1-ce0b-46b5-8c33-cb4a8c2875f9 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] [instance: 254a6894-dcb1-4909-a24e-a3a9bf701a83] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:24.280298 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-4ba86dd1-ce0b-46b5-8c33-cb4a8c2875f9 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:24.280751 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-4ba86dd1-ce0b-46b5-8c33-cb4a8c2875f9 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:24.281535 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-4ba86dd1-ce0b-46b5-8c33-cb4a8c2875f9 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:24.281992 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-4ba86dd1-ce0b-46b5-8c33-cb4a8c2875f9 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:24.392460 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-ff10c4cd-f2bf-4386-93b3-087099eeb64d tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:24.393151 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-ff10c4cd-f2bf-4386-93b3-087099eeb64d tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 454053f7-16a6-42c3-9ba0-ca0a40dc5c4b] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:24.400246 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-ff10c4cd-f2bf-4386-93b3-087099eeb64d tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:24.400958 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-ff10c4cd-f2bf-4386-93b3-087099eeb64d tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:24.401730 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-ff10c4cd-f2bf-4386-93b3-087099eeb64d tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:24.402835 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-ff10c4cd-f2bf-4386-93b3-087099eeb64d tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:24.429629 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-ff10c4cd-f2bf-4386-93b3-087099eeb64d tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 454053f7-16a6-42c3-9ba0-ca0a40dc5c4b] Going to try to terminate instance {{(pid=129953) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 11:01:24.438077 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-4ba86dd1-ce0b-46b5-8c33-cb4a8c2875f9 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2664b70cbc1a41a59f78b0b7d4e86643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd54719e5f2b41e6a875361a9188d49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:01:24.446311 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-4ba86dd1-ce0b-46b5-8c33-cb4a8c2875f9 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] 10.222.0.115 "GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83" status: 200 len: 1577 microversion: 2.1 time: 0.180366 Aug 02 11:01:24.447245 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 388/787] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:01:24 2022] GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83 => generated 1577 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:01:24.725746 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-ff10c4cd-f2bf-4386-93b3-087099eeb64d tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "DELETE /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b" status: 204 len: 0 microversion: 2.1 time: 0.337094 Aug 02 11:01:24.726344 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 400/788] 10.222.0.115 () {58 vars in 1244 bytes} [Tue Aug 2 11:01:24 2022] DELETE /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b => generated 0 bytes in 340 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 11:01:24.737483 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-b5d1f21f-28a8-4e6d-ae71-991ce2e593da tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:24.738520 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-b5d1f21f-28a8-4e6d-ae71-991ce2e593da tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 454053f7-16a6-42c3-9ba0-ca0a40dc5c4b] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:24.748725 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-b5d1f21f-28a8-4e6d-ae71-991ce2e593da tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:24.749312 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-b5d1f21f-28a8-4e6d-ae71-991ce2e593da tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:24.750627 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-b5d1f21f-28a8-4e6d-ae71-991ce2e593da tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:24.751211 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-b5d1f21f-28a8-4e6d-ae71-991ce2e593da tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:24.904281 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-b5d1f21f-28a8-4e6d-ae71-991ce2e593da tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:01:24.911955 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-b5d1f21f-28a8-4e6d-ae71-991ce2e593da tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b" status: 200 len: 1512 microversion: 2.1 time: 0.181069 Aug 02 11:01:24.912532 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 389/789] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:01:24 2022] GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b => generated 1512 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:01:25.469217 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-01a02502-4faf-495f-98bf-83a9cb178bb3 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:25.469919 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-01a02502-4faf-495f-98bf-83a9cb178bb3 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] [instance: 254a6894-dcb1-4909-a24e-a3a9bf701a83] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:25.476481 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-01a02502-4faf-495f-98bf-83a9cb178bb3 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:25.476932 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-01a02502-4faf-495f-98bf-83a9cb178bb3 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:25.477693 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-01a02502-4faf-495f-98bf-83a9cb178bb3 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:25.478131 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-01a02502-4faf-495f-98bf-83a9cb178bb3 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:25.619893 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-01a02502-4faf-495f-98bf-83a9cb178bb3 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2664b70cbc1a41a59f78b0b7d4e86643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd54719e5f2b41e6a875361a9188d49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:01:25.627555 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-01a02502-4faf-495f-98bf-83a9cb178bb3 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] 10.222.0.115 "GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83" status: 200 len: 1577 microversion: 2.1 time: 0.163238 Aug 02 11:01:25.628124 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 401/790] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:01:25 2022] GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83 => generated 1577 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:01:25.932981 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-6bb437af-c672-422c-8345-40f972a9377a tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:25.933993 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-6bb437af-c672-422c-8345-40f972a9377a tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 454053f7-16a6-42c3-9ba0-ca0a40dc5c4b] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:25.941487 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-6bb437af-c672-422c-8345-40f972a9377a tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:25.941927 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-6bb437af-c672-422c-8345-40f972a9377a tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:25.942694 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-6bb437af-c672-422c-8345-40f972a9377a tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:25.943161 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-6bb437af-c672-422c-8345-40f972a9377a tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:26.073535 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-6bb437af-c672-422c-8345-40f972a9377a tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:01:26.081558 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-6bb437af-c672-422c-8345-40f972a9377a tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b" status: 200 len: 1512 microversion: 2.1 time: 0.152561 Aug 02 11:01:26.082140 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 390/791] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:01:25 2022] GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b => generated 1512 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:01:26.648706 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-e8eefc4a-a406-4fd1-8081-e1cb97e08c44 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:26.649240 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-e8eefc4a-a406-4fd1-8081-e1cb97e08c44 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] [instance: 254a6894-dcb1-4909-a24e-a3a9bf701a83] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:26.656476 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-e8eefc4a-a406-4fd1-8081-e1cb97e08c44 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:26.656918 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-e8eefc4a-a406-4fd1-8081-e1cb97e08c44 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:26.657686 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-e8eefc4a-a406-4fd1-8081-e1cb97e08c44 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:26.658124 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-e8eefc4a-a406-4fd1-8081-e1cb97e08c44 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:26.801327 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-e8eefc4a-a406-4fd1-8081-e1cb97e08c44 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2664b70cbc1a41a59f78b0b7d4e86643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd54719e5f2b41e6a875361a9188d49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:01:26.804874 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG dbcounter [-] [129953] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=129953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 11:01:26.810080 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-e8eefc4a-a406-4fd1-8081-e1cb97e08c44 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] 10.222.0.115 "GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83" status: 200 len: 1577 microversion: 2.1 time: 0.165300 Aug 02 11:01:26.810659 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 402/792] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:01:26 2022] GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83 => generated 1577 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:01:27.104194 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-7561dcc5-16fb-4f95-ae6c-94609d27c74d tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:27.104808 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-7561dcc5-16fb-4f95-ae6c-94609d27c74d tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 454053f7-16a6-42c3-9ba0-ca0a40dc5c4b] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:27.112671 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-7561dcc5-16fb-4f95-ae6c-94609d27c74d tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:27.113125 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-7561dcc5-16fb-4f95-ae6c-94609d27c74d tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:27.113907 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-7561dcc5-16fb-4f95-ae6c-94609d27c74d tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:27.114344 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-7561dcc5-16fb-4f95-ae6c-94609d27c74d tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:27.254692 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-7561dcc5-16fb-4f95-ae6c-94609d27c74d tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:01:27.263191 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-7561dcc5-16fb-4f95-ae6c-94609d27c74d tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b" status: 200 len: 1512 microversion: 2.1 time: 0.163398 Aug 02 11:01:27.263790 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 391/793] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:01:27 2022] GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b => generated 1512 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 11:01:27.832298 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-68ac3cec-b110-42aa-943a-9b3006a2b996 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:27.832914 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-68ac3cec-b110-42aa-943a-9b3006a2b996 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] [instance: 254a6894-dcb1-4909-a24e-a3a9bf701a83] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:27.841654 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-68ac3cec-b110-42aa-943a-9b3006a2b996 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:27.842118 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-68ac3cec-b110-42aa-943a-9b3006a2b996 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:27.842874 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-68ac3cec-b110-42aa-943a-9b3006a2b996 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:27.843344 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-68ac3cec-b110-42aa-943a-9b3006a2b996 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:27.984821 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-68ac3cec-b110-42aa-943a-9b3006a2b996 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2664b70cbc1a41a59f78b0b7d4e86643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd54719e5f2b41e6a875361a9188d49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:01:27.992671 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-68ac3cec-b110-42aa-943a-9b3006a2b996 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] 10.222.0.115 "GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83" status: 200 len: 1577 microversion: 2.1 time: 0.164578 Aug 02 11:01:27.993376 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 403/794] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:01:27 2022] GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83 => generated 1577 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:01:28.284269 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-f4fd801e-1800-41a8-97a3-0bae606c50cb tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:28.284948 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-f4fd801e-1800-41a8-97a3-0bae606c50cb tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 454053f7-16a6-42c3-9ba0-ca0a40dc5c4b] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:28.292034 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-f4fd801e-1800-41a8-97a3-0bae606c50cb tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:28.292489 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-f4fd801e-1800-41a8-97a3-0bae606c50cb tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:28.293586 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-f4fd801e-1800-41a8-97a3-0bae606c50cb tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:28.294828 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-f4fd801e-1800-41a8-97a3-0bae606c50cb tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:28.462609 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-f4fd801e-1800-41a8-97a3-0bae606c50cb tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:01:28.470999 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-f4fd801e-1800-41a8-97a3-0bae606c50cb tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b" status: 200 len: 1512 microversion: 2.1 time: 0.190638 Aug 02 11:01:28.484311 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 392/795] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:01:28 2022] GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b => generated 1512 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:01:28.758922 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [req-f68b021e-cded-4a3d-8e2a-d9b099b2f804 req-98d8d122-c93e-4e96-b06a-aed1148cd0f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "454053f7-16a6-42c3-9ba0-ca0a40dc5c4b", "name": "network-vif-deleted", "tag": "5d1bea73-be61-41ee-85a1-34d315b157ef"}]} {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 11:01:28.768915 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [req-f68b021e-cded-4a3d-8e2a-d9b099b2f804 req-98d8d122-c93e-4e96-b06a-aed1148cd0f9 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:28.769352 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [req-f68b021e-cded-4a3d-8e2a-d9b099b2f804 req-98d8d122-c93e-4e96-b06a-aed1148cd0f9 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:28.782642 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.compute.server_external_events [req-f68b021e-cded-4a3d-8e2a-d9b099b2f804 req-98d8d122-c93e-4e96-b06a-aed1148cd0f9 service nova] Creating event network-vif-deleted:5d1bea73-be61-41ee-85a1-34d315b157ef for instance 454053f7-16a6-42c3-9ba0-ca0a40dc5c4b on hv-cinder-85031 Aug 02 11:01:28.787750 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [req-f68b021e-cded-4a3d-8e2a-d9b099b2f804 req-98d8d122-c93e-4e96-b06a-aed1148cd0f9 service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032557 Aug 02 11:01:28.788360 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 404/796] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Aug 2 11:01:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 11:01:29.014704 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-eebab8ef-d4e6-4331-a077-db9285167917 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:29.015351 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-eebab8ef-d4e6-4331-a077-db9285167917 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] [instance: 254a6894-dcb1-4909-a24e-a3a9bf701a83] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:29.021437 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-eebab8ef-d4e6-4331-a077-db9285167917 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:29.021892 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-eebab8ef-d4e6-4331-a077-db9285167917 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:29.022662 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-eebab8ef-d4e6-4331-a077-db9285167917 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:29.023123 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-eebab8ef-d4e6-4331-a077-db9285167917 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:29.174004 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-eebab8ef-d4e6-4331-a077-db9285167917 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2664b70cbc1a41a59f78b0b7d4e86643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd54719e5f2b41e6a875361a9188d49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:01:29.182030 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-eebab8ef-d4e6-4331-a077-db9285167917 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] 10.222.0.115 "GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83" status: 200 len: 1577 microversion: 2.1 time: 0.171843 Aug 02 11:01:29.182684 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 393/797] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:01:29 2022] GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83 => generated 1577 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:01:29.492837 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-c62ea932-aa5d-461d-b5cb-b5c8e011f3c9 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:29.493472 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-c62ea932-aa5d-461d-b5cb-b5c8e011f3c9 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 454053f7-16a6-42c3-9ba0-ca0a40dc5c4b] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:29.500706 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-c62ea932-aa5d-461d-b5cb-b5c8e011f3c9 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:29.501157 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-c62ea932-aa5d-461d-b5cb-b5c8e011f3c9 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:29.501979 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-c62ea932-aa5d-461d-b5cb-b5c8e011f3c9 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:29.502349 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-c62ea932-aa5d-461d-b5cb-b5c8e011f3c9 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:29.536778 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-c62ea932-aa5d-461d-b5cb-b5c8e011f3c9 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:29.537232 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-c62ea932-aa5d-461d-b5cb-b5c8e011f3c9 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:29.537659 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.objects.instance [None req-c62ea932-aa5d-461d-b5cb-b5c8e011f3c9 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lazy-loading 'fault' on Instance uuid 454053f7-16a6-42c3-9ba0-ca0a40dc5c4b {{(pid=129953) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 11:01:29.595427 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-c62ea932-aa5d-461d-b5cb-b5c8e011f3c9 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:01:29.604079 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-c62ea932-aa5d-461d-b5cb-b5c8e011f3c9 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b" status: 200 len: 1316 microversion: 2.1 time: 0.115474 Aug 02 11:01:29.615299 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 405/798] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:01:29 2022] GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b => generated 1316 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:01:29.679200 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-f317046f-800e-43a3-b7cf-323a0f0137dd tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:29.681448 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-f317046f-800e-43a3-b7cf-323a0f0137dd tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] [instance: 93775f02-e62c-4392-a1ed-cfd5dd956dd7] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:29.688331 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-f317046f-800e-43a3-b7cf-323a0f0137dd tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:29.688786 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-f317046f-800e-43a3-b7cf-323a0f0137dd tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:29.689532 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-f317046f-800e-43a3-b7cf-323a0f0137dd tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:29.689955 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-f317046f-800e-43a3-b7cf-323a0f0137dd tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:29.720787 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-f317046f-800e-43a3-b7cf-323a0f0137dd tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] 10.222.0.115 "GET /compute/v2.1/servers/93775f02-e62c-4392-a1ed-cfd5dd956dd7/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045511 Aug 02 11:01:29.721354 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 394/799] 10.222.0.115 () {58 vars in 1307 bytes} [Tue Aug 2 11:01:29 2022] GET /compute/v2.1/servers/93775f02-e62c-4392-a1ed-cfd5dd956dd7/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 11:01:29.881652 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-81bc2d71-d398-4170-8ce8-b2c1af5cf91f tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:29.882068 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-81bc2d71-d398-4170-8ce8-b2c1af5cf91f tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] [instance: 93775f02-e62c-4392-a1ed-cfd5dd956dd7] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:29.888689 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-81bc2d71-d398-4170-8ce8-b2c1af5cf91f tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:29.889136 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-81bc2d71-d398-4170-8ce8-b2c1af5cf91f tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:29.889926 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-81bc2d71-d398-4170-8ce8-b2c1af5cf91f tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:29.890358 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-81bc2d71-d398-4170-8ce8-b2c1af5cf91f tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:29.920535 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-81bc2d71-d398-4170-8ce8-b2c1af5cf91f tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] 10.222.0.115 "GET /compute/v2.1/servers/93775f02-e62c-4392-a1ed-cfd5dd956dd7/os-volume_attachments/9f6e0b60-47e6-4d48-a6ca-f0a4482f30af" status: 200 len: 194 microversion: 2.1 time: 0.042936 Aug 02 11:01:29.921133 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 406/800] 10.222.0.115 () {58 vars in 1418 bytes} [Tue Aug 2 11:01:29 2022] GET /compute/v2.1/servers/93775f02-e62c-4392-a1ed-cfd5dd956dd7/os-volume_attachments/9f6e0b60-47e6-4d48-a6ca-f0a4482f30af => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 11:01:29.931579 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-1916e57b-377a-4862-b476-f4ee0280892e tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:29.932059 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-1916e57b-377a-4862-b476-f4ee0280892e tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] [instance: 93775f02-e62c-4392-a1ed-cfd5dd956dd7] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:29.939449 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-1916e57b-377a-4862-b476-f4ee0280892e tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:29.939897 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-1916e57b-377a-4862-b476-f4ee0280892e tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:29.940672 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-1916e57b-377a-4862-b476-f4ee0280892e tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:29.941107 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-1916e57b-377a-4862-b476-f4ee0280892e tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:30.026308 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.objects.instance [None req-1916e57b-377a-4862-b476-f4ee0280892e tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lazy-loading 'services' on Instance uuid 93775f02-e62c-4392-a1ed-cfd5dd956dd7 {{(pid=129952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 11:01:30.207535 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-5f5530a3-131a-4510-b292-366cf4e4dce5 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:30.208142 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-5f5530a3-131a-4510-b292-366cf4e4dce5 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] [instance: 254a6894-dcb1-4909-a24e-a3a9bf701a83] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:30.214308 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-5f5530a3-131a-4510-b292-366cf4e4dce5 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:30.214787 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-5f5530a3-131a-4510-b292-366cf4e4dce5 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:30.215589 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-5f5530a3-131a-4510-b292-366cf4e4dce5 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:30.216017 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-5f5530a3-131a-4510-b292-366cf4e4dce5 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:30.263186 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-1916e57b-377a-4862-b476-f4ee0280892e tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] 10.222.0.115 "DELETE /compute/v2.1/servers/93775f02-e62c-4392-a1ed-cfd5dd956dd7/os-volume_attachments/9f6e0b60-47e6-4d48-a6ca-f0a4482f30af" status: 202 len: 0 microversion: 2.1 time: 0.335100 Aug 02 11:01:30.263832 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 395/801] 10.222.0.115 () {58 vars in 1421 bytes} [Tue Aug 2 11:01:29 2022] DELETE /compute/v2.1/servers/93775f02-e62c-4392-a1ed-cfd5dd956dd7/os-volume_attachments/9f6e0b60-47e6-4d48-a6ca-f0a4482f30af => generated 0 bytes in 337 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 11:01:30.372423 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-5f5530a3-131a-4510-b292-366cf4e4dce5 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2664b70cbc1a41a59f78b0b7d4e86643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd54719e5f2b41e6a875361a9188d49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:01:30.392013 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-5f5530a3-131a-4510-b292-366cf4e4dce5 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] 10.222.0.115 "GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83" status: 200 len: 1577 microversion: 2.1 time: 0.177203 Aug 02 11:01:30.392013 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 407/802] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:01:30 2022] GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83 => generated 1577 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 11:01:30.626253 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-bf43ba15-e146-4984-838f-81f395e4b394 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:30.626946 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-bf43ba15-e146-4984-838f-81f395e4b394 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: 454053f7-16a6-42c3-9ba0-ca0a40dc5c4b] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:30.634400 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-bf43ba15-e146-4984-838f-81f395e4b394 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:30.634847 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-bf43ba15-e146-4984-838f-81f395e4b394 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:30.635735 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-bf43ba15-e146-4984-838f-81f395e4b394 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:30.636161 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-bf43ba15-e146-4984-838f-81f395e4b394 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:30.649891 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.wsgi [None req-bf43ba15-e146-4984-838f-81f395e4b394 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] HTTP exception thrown: Instance 454053f7-16a6-42c3-9ba0-ca0a40dc5c4b could not be found. Aug 02 11:01:30.651822 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-bf43ba15-e146-4984-838f-81f395e4b394 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Request method failure captured: Aug 02 11:01:30.651822 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: request: GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b HTTP/1.1 Aug 02 11:01:30.651822 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Accept: application/json Aug 02 11:01:30.651822 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Accept-Encoding: identity Aug 02 11:01:30.651822 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Connection: close Aug 02 11:01:30.651822 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Content-Length: 0 Aug 02 11:01:30.651822 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Content-Type: application/json Aug 02 11:01:30.651822 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Host: 10.222.0.115 Aug 02 11:01:30.651822 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Openstack-System-Scope: None Aug 02 11:01:30.651822 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: User-Agent: python-urllib3/1.26.10 Aug 02 11:01:30.651822 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Auth-Token: gAAAAABi6QLU4-kFVceoHWEpo94bbvBf1uqlEx4Gmz_ix8LIhs0hb3WYrUk_oMQ3oj3o3ZEWUh1MDl3j04cDaiOxlt6Nmx19h9H9o9YzMFcctjtmr66KQ4MTn2pZ5x6hWud4Dyg2XcQVpsrwtFErHKVVnsJz6A5M7HawuEHdbt-qhQJOR6Lin2k Aug 02 11:01:30.651822 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Domain-Id: None Aug 02 11:01:30.651822 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Domain-Name: None Aug 02 11:01:30.651822 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Identity-Status: Confirmed Aug 02 11:01:30.651822 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Is-Admin-Project: True Aug 02 11:01:30.651822 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Project-Domain-Id: default Aug 02 11:01:30.651822 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Project-Domain-Name: Default Aug 02 11:01:30.651822 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Project-Id: 0d99d3fd13df429a8ee8a7cb7780adb5 Aug 02 11:01:30.651822 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1563347873 Aug 02 11:01:30.651822 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Role: reader,member Aug 02 11:01:30.651822 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Roles: reader,member Aug 02 11:01:30.653493 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/0d99d3fd13df429a8ee8a7cb7780adb5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2/0d99d3fd13df429a8ee8a7cb7780adb5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/0d99d3fd13df429a8ee8a7cb7780adb5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.115:8080", "publicURL": "http://10.222.0.115:8080/v1/AUTH_0d99d3fd13df429a8ee8a7cb7780adb5"}]}] Aug 02 11:01:30.653493 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1563347873 Aug 02 11:01:30.653493 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Tenant-Id: 0d99d3fd13df429a8ee8a7cb7780adb5 Aug 02 11:01:30.653493 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1563347873 Aug 02 11:01:30.653493 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User: tempest-ServerRescueNegativeTestJSON-1563347873-project Aug 02 11:01:30.653493 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User-Domain-Id: default Aug 02 11:01:30.653493 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User-Domain-Name: Default Aug 02 11:01:30.653493 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User-Id: 3057a53debc34c829372c03567e1119d Aug 02 11:01:30.653493 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1563347873-project Aug 02 11:01:30.653493 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: method: > Aug 02 11:01:30.653493 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: exception: Instance 454053f7-16a6-42c3-9ba0-ca0a40dc5c4b could not be found. Aug 02 11:01:30.653493 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: action_args: {'id': '454053f7-16a6-42c3-9ba0-ca0a40dc5c4b'} Aug 02 11:01:30.654308 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 11:01:30.654308 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:01:30.654308 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 11:01:30.654308 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 11:01:30.654308 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 11:01:30.654308 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 11:01:30.654308 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 11:01:30.654308 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 11:01:30.654308 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 11:01:30.654308 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 11:01:30.654308 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 454053f7-16a6-42c3-9ba0-ca0a40dc5c4b could not be found. Aug 02 11:01:30.654308 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 11:01:30.654308 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 11:01:30.654308 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 11:01:30.654308 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:01:30.654308 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 11:01:30.654308 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 11:01:30.654308 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 11:01:30.654308 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 11:01:30.654308 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 11:01:30.655520 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 11:01:30.655520 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 11:01:30.655520 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 11:01:30.655520 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 11:01:30.655520 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 11:01:30.655520 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 11:01:30.655520 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 11:01:30.655520 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 454053f7-16a6-42c3-9ba0-ca0a40dc5c4b could not be found. Aug 02 11:01:30.655520 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 11:01:30.655520 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 11:01:30.655520 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 11:01:30.655520 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:01:30.655520 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 11:01:30.655520 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 11:01:30.655520 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 11:01:30.655520 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 11:01:30.655520 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 454053f7-16a6-42c3-9ba0-ca0a40dc5c4b could not be found. Aug 02 11:01:30.655520 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 11:01:30.656580 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-bf43ba15-e146-4984-838f-81f395e4b394 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Returning 404 to user: Instance 454053f7-16a6-42c3-9ba0-ca0a40dc5c4b could not be found. {{(pid=129952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 11:01:30.656580 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-bf43ba15-e146-4984-838f-81f395e4b394 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b" status: 404 len: 111 microversion: 2.1 time: 0.031260 Aug 02 11:01:30.656580 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 396/803] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:01:30 2022] GET /compute/v2.1/servers/454053f7-16a6-42c3-9ba0-ca0a40dc5c4b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 11:01:30.662088 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-56fe40ef-36c3-485b-8225-f8f9f3788f74 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:30.662610 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-56fe40ef-36c3-485b-8225-f8f9f3788f74 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: e7deeb40-9fc3-40f8-b564-192fe68fa113] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:30.669852 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-56fe40ef-36c3-485b-8225-f8f9f3788f74 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:30.670544 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-56fe40ef-36c3-485b-8225-f8f9f3788f74 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:30.671038 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-56fe40ef-36c3-485b-8225-f8f9f3788f74 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:30.672042 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-56fe40ef-36c3-485b-8225-f8f9f3788f74 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:30.698318 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-56fe40ef-36c3-485b-8225-f8f9f3788f74 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: e7deeb40-9fc3-40f8-b564-192fe68fa113] Going to try to terminate instance {{(pid=129953) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 11:01:31.034715 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-56fe40ef-36c3-485b-8225-f8f9f3788f74 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "DELETE /compute/v2.1/servers/e7deeb40-9fc3-40f8-b564-192fe68fa113" status: 204 len: 0 microversion: 2.1 time: 0.376133 Aug 02 11:01:31.035613 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 408/804] 10.222.0.115 () {58 vars in 1244 bytes} [Tue Aug 2 11:01:30 2022] DELETE /compute/v2.1/servers/e7deeb40-9fc3-40f8-b564-192fe68fa113 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 11:01:31.043735 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-97209939-becb-4398-bd77-95dde623cb73 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:31.045134 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-97209939-becb-4398-bd77-95dde623cb73 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: e7deeb40-9fc3-40f8-b564-192fe68fa113] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:31.052054 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-97209939-becb-4398-bd77-95dde623cb73 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:31.052498 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-97209939-becb-4398-bd77-95dde623cb73 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:31.053259 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-97209939-becb-4398-bd77-95dde623cb73 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:31.053690 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-97209939-becb-4398-bd77-95dde623cb73 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:31.189347 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-97209939-becb-4398-bd77-95dde623cb73 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:01:31.197536 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-97209939-becb-4398-bd77-95dde623cb73 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/e7deeb40-9fc3-40f8-b564-192fe68fa113" status: 200 len: 1525 microversion: 2.1 time: 0.157524 Aug 02 11:01:31.198104 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 397/805] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:01:31 2022] GET /compute/v2.1/servers/e7deeb40-9fc3-40f8-b564-192fe68fa113 => generated 1525 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:01:31.405550 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-53c1a0bf-bb7f-499d-b2e0-3b8b973c71e4 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:31.408904 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-53c1a0bf-bb7f-499d-b2e0-3b8b973c71e4 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] [instance: 254a6894-dcb1-4909-a24e-a3a9bf701a83] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:31.412256 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-53c1a0bf-bb7f-499d-b2e0-3b8b973c71e4 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:31.412701 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-53c1a0bf-bb7f-499d-b2e0-3b8b973c71e4 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:31.413455 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-53c1a0bf-bb7f-499d-b2e0-3b8b973c71e4 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:31.413886 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-53c1a0bf-bb7f-499d-b2e0-3b8b973c71e4 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:31.554802 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-53c1a0bf-bb7f-499d-b2e0-3b8b973c71e4 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2664b70cbc1a41a59f78b0b7d4e86643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd54719e5f2b41e6a875361a9188d49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:01:31.563254 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-53c1a0bf-bb7f-499d-b2e0-3b8b973c71e4 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] 10.222.0.115 "GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83" status: 200 len: 1577 microversion: 2.1 time: 0.162900 Aug 02 11:01:31.563821 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 409/806] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:01:31 2022] GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83 => generated 1577 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:01:32.219897 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-883ad491-760a-4308-9dfb-c3a957b44270 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:32.220464 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-883ad491-760a-4308-9dfb-c3a957b44270 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: e7deeb40-9fc3-40f8-b564-192fe68fa113] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:32.227336 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-883ad491-760a-4308-9dfb-c3a957b44270 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:32.227786 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-883ad491-760a-4308-9dfb-c3a957b44270 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:32.228571 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-883ad491-760a-4308-9dfb-c3a957b44270 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:32.229000 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-883ad491-760a-4308-9dfb-c3a957b44270 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:32.368704 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-883ad491-760a-4308-9dfb-c3a957b44270 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:01:32.376537 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-883ad491-760a-4308-9dfb-c3a957b44270 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/e7deeb40-9fc3-40f8-b564-192fe68fa113" status: 200 len: 1525 microversion: 2.1 time: 0.160983 Aug 02 11:01:32.378669 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 398/807] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:01:32 2022] GET /compute/v2.1/servers/e7deeb40-9fc3-40f8-b564-192fe68fa113 => generated 1525 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 11:01:32.582496 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [req-11dee980-abb3-44e7-acf5-82e2e56e96c6 req-9f39b8dc-f09f-4f0c-86f9-1d1ac3220339 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "254a6894-dcb1-4909-a24e-a3a9bf701a83", "name": "network-vif-plugged", "status": "completed", "tag": "950f72fe-d9c4-4546-b649-bf02fe995cd8"}]} {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 11:01:32.586738 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-ecc0c031-2379-48a4-b459-dac7fc53cb4a tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:32.588045 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-ecc0c031-2379-48a4-b459-dac7fc53cb4a tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] [instance: 254a6894-dcb1-4909-a24e-a3a9bf701a83] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:32.589183 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG dbcounter [-] [129953] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=129953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 11:01:32.593702 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [req-11dee980-abb3-44e7-acf5-82e2e56e96c6 req-9f39b8dc-f09f-4f0c-86f9-1d1ac3220339 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:32.594135 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [req-11dee980-abb3-44e7-acf5-82e2e56e96c6 req-9f39b8dc-f09f-4f0c-86f9-1d1ac3220339 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:32.596246 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-ecc0c031-2379-48a4-b459-dac7fc53cb4a tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:32.596686 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-ecc0c031-2379-48a4-b459-dac7fc53cb4a tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:32.597655 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-ecc0c031-2379-48a4-b459-dac7fc53cb4a tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:32.598096 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-ecc0c031-2379-48a4-b459-dac7fc53cb4a tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:32.605810 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.compute.server_external_events [req-11dee980-abb3-44e7-acf5-82e2e56e96c6 req-9f39b8dc-f09f-4f0c-86f9-1d1ac3220339 service nova] Creating event network-vif-plugged:950f72fe-d9c4-4546-b649-bf02fe995cd8 for instance 254a6894-dcb1-4909-a24e-a3a9bf701a83 on hv-cinder-85031 Aug 02 11:01:32.611745 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [req-11dee980-abb3-44e7-acf5-82e2e56e96c6 req-9f39b8dc-f09f-4f0c-86f9-1d1ac3220339 service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032878 Aug 02 11:01:32.612345 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 410/808] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Aug 2 11:01:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 11:01:32.746245 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-ecc0c031-2379-48a4-b459-dac7fc53cb4a tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2664b70cbc1a41a59f78b0b7d4e86643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd54719e5f2b41e6a875361a9188d49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:01:32.754599 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-ecc0c031-2379-48a4-b459-dac7fc53cb4a tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] 10.222.0.115 "GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83" status: 200 len: 1577 microversion: 2.1 time: 0.173098 Aug 02 11:01:32.756960 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 399/809] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:01:32 2022] GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83 => generated 1577 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:01:33.398479 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-196d5b71-7282-40f9-8994-3305ab4295fa tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:33.399208 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-196d5b71-7282-40f9-8994-3305ab4295fa tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: e7deeb40-9fc3-40f8-b564-192fe68fa113] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:33.406540 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-196d5b71-7282-40f9-8994-3305ab4295fa tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:33.406979 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-196d5b71-7282-40f9-8994-3305ab4295fa tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:33.407763 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-196d5b71-7282-40f9-8994-3305ab4295fa tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:33.408190 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-196d5b71-7282-40f9-8994-3305ab4295fa tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:33.542186 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-196d5b71-7282-40f9-8994-3305ab4295fa tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:01:33.550018 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-196d5b71-7282-40f9-8994-3305ab4295fa tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/e7deeb40-9fc3-40f8-b564-192fe68fa113" status: 200 len: 1525 microversion: 2.1 time: 0.156145 Aug 02 11:01:33.550584 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 411/810] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:01:33 2022] GET /compute/v2.1/servers/e7deeb40-9fc3-40f8-b564-192fe68fa113 => generated 1525 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:01:33.776726 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-720dff71-2885-479a-8985-c0bc8173a828 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:33.777740 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-720dff71-2885-479a-8985-c0bc8173a828 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] [instance: 254a6894-dcb1-4909-a24e-a3a9bf701a83] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:33.789701 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-720dff71-2885-479a-8985-c0bc8173a828 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:33.790510 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-720dff71-2885-479a-8985-c0bc8173a828 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:33.792009 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-720dff71-2885-479a-8985-c0bc8173a828 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:33.792874 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-720dff71-2885-479a-8985-c0bc8173a828 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:33.935293 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-720dff71-2885-479a-8985-c0bc8173a828 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2664b70cbc1a41a59f78b0b7d4e86643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd54719e5f2b41e6a875361a9188d49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:01:33.943810 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-720dff71-2885-479a-8985-c0bc8173a828 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] 10.222.0.115 "GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83" status: 200 len: 1577 microversion: 2.1 time: 0.171260 Aug 02 11:01:33.948671 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 400/811] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:01:33 2022] GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83 => generated 1577 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:01:34.573808 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-1187a8d0-39fb-47e2-a287-ad5550d75999 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:34.574419 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-1187a8d0-39fb-47e2-a287-ad5550d75999 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: e7deeb40-9fc3-40f8-b564-192fe68fa113] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:34.590632 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-1187a8d0-39fb-47e2-a287-ad5550d75999 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:34.590632 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-1187a8d0-39fb-47e2-a287-ad5550d75999 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:34.590632 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-1187a8d0-39fb-47e2-a287-ad5550d75999 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:34.590632 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-1187a8d0-39fb-47e2-a287-ad5550d75999 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:34.619756 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [req-21b11a8a-7e52-4912-9a86-089affceef33 req-ceb7309e-7fa9-4686-9695-ed7fef31b04f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7deeb40-9fc3-40f8-b564-192fe68fa113", "name": "network-vif-deleted", "tag": "f402df7f-32e4-4cbd-9bdb-6f6e8d92473e"}]} {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 11:01:34.630852 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [req-21b11a8a-7e52-4912-9a86-089affceef33 req-ceb7309e-7fa9-4686-9695-ed7fef31b04f service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:34.631375 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [req-21b11a8a-7e52-4912-9a86-089affceef33 req-ceb7309e-7fa9-4686-9695-ed7fef31b04f service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:34.647501 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.compute.server_external_events [req-21b11a8a-7e52-4912-9a86-089affceef33 req-ceb7309e-7fa9-4686-9695-ed7fef31b04f service nova] Creating event network-vif-deleted:f402df7f-32e4-4cbd-9bdb-6f6e8d92473e for instance e7deeb40-9fc3-40f8-b564-192fe68fa113 on hv-cinder-85031 Aug 02 11:01:34.653120 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [req-21b11a8a-7e52-4912-9a86-089affceef33 req-ceb7309e-7fa9-4686-9695-ed7fef31b04f service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036885 Aug 02 11:01:34.653741 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 401/812] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Aug 2 11:01:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 11:01:34.666334 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-1187a8d0-39fb-47e2-a287-ad5550d75999 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:01:34.676870 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-1187a8d0-39fb-47e2-a287-ad5550d75999 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/e7deeb40-9fc3-40f8-b564-192fe68fa113" status: 200 len: 1483 microversion: 2.1 time: 0.107467 Aug 02 11:01:34.677675 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 412/813] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:01:34 2022] GET /compute/v2.1/servers/e7deeb40-9fc3-40f8-b564-192fe68fa113 => generated 1483 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:01:34.970194 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-192f5ccf-5387-4237-b5c5-fb35ff5b6317 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:34.970715 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-192f5ccf-5387-4237-b5c5-fb35ff5b6317 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] [instance: 254a6894-dcb1-4909-a24e-a3a9bf701a83] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:34.977595 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-192f5ccf-5387-4237-b5c5-fb35ff5b6317 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:34.979675 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-192f5ccf-5387-4237-b5c5-fb35ff5b6317 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:34.979675 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-192f5ccf-5387-4237-b5c5-fb35ff5b6317 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:34.979675 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-192f5ccf-5387-4237-b5c5-fb35ff5b6317 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:35.145647 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-192f5ccf-5387-4237-b5c5-fb35ff5b6317 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2664b70cbc1a41a59f78b0b7d4e86643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd54719e5f2b41e6a875361a9188d49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:01:35.154922 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-192f5ccf-5387-4237-b5c5-fb35ff5b6317 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] 10.222.0.115 "GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83" status: 200 len: 1577 microversion: 2.1 time: 0.190712 Aug 02 11:01:35.155548 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 402/814] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:01:34 2022] GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83 => generated 1577 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 11:01:35.698854 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-ce09a256-7d20-4263-952c-f8e0c365d749 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:35.699579 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-ce09a256-7d20-4263-952c-f8e0c365d749 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: e7deeb40-9fc3-40f8-b564-192fe68fa113] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:35.706666 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-ce09a256-7d20-4263-952c-f8e0c365d749 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:35.707135 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-ce09a256-7d20-4263-952c-f8e0c365d749 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:35.708001 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-ce09a256-7d20-4263-952c-f8e0c365d749 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:35.708321 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-ce09a256-7d20-4263-952c-f8e0c365d749 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:35.747543 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-ce09a256-7d20-4263-952c-f8e0c365d749 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:35.748015 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-ce09a256-7d20-4263-952c-f8e0c365d749 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:35.748369 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.objects.instance [None req-ce09a256-7d20-4263-952c-f8e0c365d749 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lazy-loading 'fault' on Instance uuid e7deeb40-9fc3-40f8-b564-192fe68fa113 {{(pid=129953) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 11:01:35.792114 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-ce09a256-7d20-4263-952c-f8e0c365d749 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:01:35.801250 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-ce09a256-7d20-4263-952c-f8e0c365d749 tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/e7deeb40-9fc3-40f8-b564-192fe68fa113" status: 200 len: 1316 microversion: 2.1 time: 0.106212 Aug 02 11:01:35.801840 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 413/815] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:01:35 2022] GET /compute/v2.1/servers/e7deeb40-9fc3-40f8-b564-192fe68fa113 => generated 1316 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:01:36.179900 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-7247efb7-d11e-431d-bd1f-b4993696a51e tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:36.180545 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-7247efb7-d11e-431d-bd1f-b4993696a51e tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] [instance: 254a6894-dcb1-4909-a24e-a3a9bf701a83] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:36.188080 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-7247efb7-d11e-431d-bd1f-b4993696a51e tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:36.188532 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-7247efb7-d11e-431d-bd1f-b4993696a51e tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:36.189299 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-7247efb7-d11e-431d-bd1f-b4993696a51e tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:36.189734 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-7247efb7-d11e-431d-bd1f-b4993696a51e tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:36.325918 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-7247efb7-d11e-431d-bd1f-b4993696a51e tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2664b70cbc1a41a59f78b0b7d4e86643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd54719e5f2b41e6a875361a9188d49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:01:36.333478 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-7247efb7-d11e-431d-bd1f-b4993696a51e tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] 10.222.0.115 "GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83" status: 200 len: 1564 microversion: 2.1 time: 0.157542 Aug 02 11:01:36.334046 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 403/816] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:01:36 2022] GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83 => generated 1564 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:01:36.821831 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-294ac617-423f-4ef5-9985-db000afe6c8f tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:36.822429 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-294ac617-423f-4ef5-9985-db000afe6c8f tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: e7deeb40-9fc3-40f8-b564-192fe68fa113] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:36.829126 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-294ac617-423f-4ef5-9985-db000afe6c8f tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:36.829567 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-294ac617-423f-4ef5-9985-db000afe6c8f tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:36.830320 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-294ac617-423f-4ef5-9985-db000afe6c8f tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:36.830750 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-294ac617-423f-4ef5-9985-db000afe6c8f tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:36.862703 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-294ac617-423f-4ef5-9985-db000afe6c8f tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:36.863176 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-294ac617-423f-4ef5-9985-db000afe6c8f tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:36.863637 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.objects.instance [None req-294ac617-423f-4ef5-9985-db000afe6c8f tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lazy-loading 'fault' on Instance uuid e7deeb40-9fc3-40f8-b564-192fe68fa113 {{(pid=129953) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 11:01:36.914312 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-294ac617-423f-4ef5-9985-db000afe6c8f tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3057a53debc34c829372c03567e1119d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d99d3fd13df429a8ee8a7cb7780adb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:01:36.923122 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-294ac617-423f-4ef5-9985-db000afe6c8f tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/e7deeb40-9fc3-40f8-b564-192fe68fa113" status: 200 len: 1316 microversion: 2.1 time: 0.105171 Aug 02 11:01:36.923692 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 414/817] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:01:36 2022] GET /compute/v2.1/servers/e7deeb40-9fc3-40f8-b564-192fe68fa113 => generated 1316 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:01:37.944243 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-563350e0-ead7-4ba8-83cd-6582d5284c1c tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:37.944865 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-563350e0-ead7-4ba8-83cd-6582d5284c1c tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] [instance: e7deeb40-9fc3-40f8-b564-192fe68fa113] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:37.952006 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-563350e0-ead7-4ba8-83cd-6582d5284c1c tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:37.952459 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-563350e0-ead7-4ba8-83cd-6582d5284c1c tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:37.953228 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-563350e0-ead7-4ba8-83cd-6582d5284c1c tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:37.953666 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-563350e0-ead7-4ba8-83cd-6582d5284c1c tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:37.967749 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.wsgi [None req-563350e0-ead7-4ba8-83cd-6582d5284c1c tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] HTTP exception thrown: Instance e7deeb40-9fc3-40f8-b564-192fe68fa113 could not be found. Aug 02 11:01:37.969383 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-563350e0-ead7-4ba8-83cd-6582d5284c1c tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Request method failure captured: Aug 02 11:01:37.969383 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: request: GET /compute/v2.1/servers/e7deeb40-9fc3-40f8-b564-192fe68fa113 HTTP/1.1 Aug 02 11:01:37.969383 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Accept: application/json Aug 02 11:01:37.969383 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Accept-Encoding: identity Aug 02 11:01:37.969383 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Connection: close Aug 02 11:01:37.969383 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Content-Length: 0 Aug 02 11:01:37.969383 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Content-Type: application/json Aug 02 11:01:37.969383 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Host: 10.222.0.115 Aug 02 11:01:37.969383 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Openstack-System-Scope: None Aug 02 11:01:37.969383 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: User-Agent: python-urllib3/1.26.10 Aug 02 11:01:37.969383 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Auth-Token: gAAAAABi6QLU4-kFVceoHWEpo94bbvBf1uqlEx4Gmz_ix8LIhs0hb3WYrUk_oMQ3oj3o3ZEWUh1MDl3j04cDaiOxlt6Nmx19h9H9o9YzMFcctjtmr66KQ4MTn2pZ5x6hWud4Dyg2XcQVpsrwtFErHKVVnsJz6A5M7HawuEHdbt-qhQJOR6Lin2k Aug 02 11:01:37.969383 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Domain-Id: None Aug 02 11:01:37.969383 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Domain-Name: None Aug 02 11:01:37.969383 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Identity-Status: Confirmed Aug 02 11:01:37.969383 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Is-Admin-Project: True Aug 02 11:01:37.969383 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Project-Domain-Id: default Aug 02 11:01:37.969383 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Project-Domain-Name: Default Aug 02 11:01:37.969383 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Project-Id: 0d99d3fd13df429a8ee8a7cb7780adb5 Aug 02 11:01:37.969383 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1563347873 Aug 02 11:01:37.969383 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Role: reader,member Aug 02 11:01:37.969383 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Roles: reader,member Aug 02 11:01:37.971244 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/0d99d3fd13df429a8ee8a7cb7780adb5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2/0d99d3fd13df429a8ee8a7cb7780adb5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/0d99d3fd13df429a8ee8a7cb7780adb5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.115:8080", "publicURL": "http://10.222.0.115:8080/v1/AUTH_0d99d3fd13df429a8ee8a7cb7780adb5"}]}] Aug 02 11:01:37.971244 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1563347873 Aug 02 11:01:37.971244 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Tenant-Id: 0d99d3fd13df429a8ee8a7cb7780adb5 Aug 02 11:01:37.971244 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1563347873 Aug 02 11:01:37.971244 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User: tempest-ServerRescueNegativeTestJSON-1563347873-project Aug 02 11:01:37.971244 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User-Domain-Id: default Aug 02 11:01:37.971244 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User-Domain-Name: Default Aug 02 11:01:37.971244 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User-Id: 3057a53debc34c829372c03567e1119d Aug 02 11:01:37.971244 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1563347873-project Aug 02 11:01:37.971244 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: method: > Aug 02 11:01:37.971244 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: exception: Instance e7deeb40-9fc3-40f8-b564-192fe68fa113 could not be found. Aug 02 11:01:37.971244 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: action_args: {'id': 'e7deeb40-9fc3-40f8-b564-192fe68fa113'} Aug 02 11:01:37.972364 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 11:01:37.972364 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:01:37.972364 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 11:01:37.972364 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 11:01:37.972364 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 11:01:37.972364 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 11:01:37.972364 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 11:01:37.972364 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 11:01:37.972364 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 11:01:37.972364 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 11:01:37.972364 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7deeb40-9fc3-40f8-b564-192fe68fa113 could not be found. Aug 02 11:01:37.972364 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 11:01:37.972364 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 11:01:37.972364 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 11:01:37.972364 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:01:37.972364 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 11:01:37.972364 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 11:01:37.972364 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 11:01:37.972364 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 11:01:37.972364 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 11:01:37.973931 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 11:01:37.973931 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 11:01:37.973931 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 11:01:37.973931 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 11:01:37.973931 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 11:01:37.973931 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 11:01:37.973931 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 11:01:37.973931 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7deeb40-9fc3-40f8-b564-192fe68fa113 could not be found. Aug 02 11:01:37.973931 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 11:01:37.973931 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 11:01:37.973931 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 11:01:37.973931 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:01:37.973931 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 11:01:37.973931 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 11:01:37.973931 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 11:01:37.973931 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 11:01:37.973931 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7deeb40-9fc3-40f8-b564-192fe68fa113 could not be found. Aug 02 11:01:37.973931 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 11:01:37.975490 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-563350e0-ead7-4ba8-83cd-6582d5284c1c tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] Returning 404 to user: Instance e7deeb40-9fc3-40f8-b564-192fe68fa113 could not be found. {{(pid=129952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 11:01:37.975490 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-563350e0-ead7-4ba8-83cd-6582d5284c1c tempest-ServerRescueNegativeTestJSON-1563347873 tempest-ServerRescueNegativeTestJSON-1563347873-project] 10.222.0.115 "GET /compute/v2.1/servers/e7deeb40-9fc3-40f8-b564-192fe68fa113" status: 404 len: 111 microversion: 2.1 time: 0.030515 Aug 02 11:01:37.975490 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 404/818] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:01:37 2022] GET /compute/v2.1/servers/e7deeb40-9fc3-40f8-b564-192fe68fa113 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 11:01:38.483134 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-88732518-bc41-4911-9d17-be1fb421556a tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:38.483685 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-88732518-bc41-4911-9d17-be1fb421556a tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: 07d63415-e151-4b2f-93ff-0769c401f16b] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:38.490002 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-88732518-bc41-4911-9d17-be1fb421556a tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:38.490576 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-88732518-bc41-4911-9d17-be1fb421556a tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:38.491441 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-88732518-bc41-4911-9d17-be1fb421556a tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:38.491820 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-88732518-bc41-4911-9d17-be1fb421556a tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:38.576738 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.objects.instance [None req-88732518-bc41-4911-9d17-be1fb421556a tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lazy-loading 'services' on Instance uuid 07d63415-e151-4b2f-93ff-0769c401f16b {{(pid=129953) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 11:01:38.829461 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-88732518-bc41-4911-9d17-be1fb421556a tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "DELETE /compute/v2.1/servers/07d63415-e151-4b2f-93ff-0769c401f16b/os-volume_attachments/d74fb775-1648-4215-ad4f-a52ec636ae1d" status: 202 len: 0 microversion: 2.1 time: 0.350270 Aug 02 11:01:38.830422 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 415/819] 10.222.0.115 () {58 vars in 1421 bytes} [Tue Aug 2 11:01:38 2022] DELETE /compute/v2.1/servers/07d63415-e151-4b2f-93ff-0769c401f16b/os-volume_attachments/d74fb775-1648-4215-ad4f-a52ec636ae1d => generated 0 bytes in 352 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 11:01:38.836876 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-f63fc75b-8b72-41c7-baa1-07aa8f9ce962 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:38.837633 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-f63fc75b-8b72-41c7-baa1-07aa8f9ce962 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] [instance: 93775f02-e62c-4392-a1ed-cfd5dd956dd7] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:38.839763 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-910400ba-3775-4e7d-b5b0-c08a47ae4fc0 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:38.842182 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-910400ba-3775-4e7d-b5b0-c08a47ae4fc0 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: 07d63415-e151-4b2f-93ff-0769c401f16b] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:38.845370 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-f63fc75b-8b72-41c7-baa1-07aa8f9ce962 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:38.846599 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-f63fc75b-8b72-41c7-baa1-07aa8f9ce962 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:38.847646 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-f63fc75b-8b72-41c7-baa1-07aa8f9ce962 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:38.848454 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-f63fc75b-8b72-41c7-baa1-07aa8f9ce962 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:38.851828 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-910400ba-3775-4e7d-b5b0-c08a47ae4fc0 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:38.852411 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-910400ba-3775-4e7d-b5b0-c08a47ae4fc0 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:38.853266 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-910400ba-3775-4e7d-b5b0-c08a47ae4fc0 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:38.853790 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-910400ba-3775-4e7d-b5b0-c08a47ae4fc0 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:38.854543 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG dbcounter [-] [129952] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=129952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 11:01:38.887222 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-f63fc75b-8b72-41c7-baa1-07aa8f9ce962 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] 10.222.0.115 "GET /compute/v2.1/servers/93775f02-e62c-4392-a1ed-cfd5dd956dd7/os-volume_attachments/4cf32135-1022-4abf-83f5-94139c1da0e7" status: 200 len: 194 microversion: 2.1 time: 0.055323 Aug 02 11:01:38.887876 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 405/820] 10.222.0.115 () {58 vars in 1418 bytes} [Tue Aug 2 11:01:38 2022] GET /compute/v2.1/servers/93775f02-e62c-4392-a1ed-cfd5dd956dd7/os-volume_attachments/4cf32135-1022-4abf-83f5-94139c1da0e7 => generated 194 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 11:01:38.888286 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-910400ba-3775-4e7d-b5b0-c08a47ae4fc0 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "GET /compute/v2.1/servers/07d63415-e151-4b2f-93ff-0769c401f16b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052739 Aug 02 11:01:38.889020 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 416/821] 10.222.0.115 () {58 vars in 1307 bytes} [Tue Aug 2 11:01:38 2022] GET /compute/v2.1/servers/07d63415-e151-4b2f-93ff-0769c401f16b/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 11:01:38.898671 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-0d0e0989-873a-4030-ba2f-43370f303fad tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:38.899326 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-0d0e0989-873a-4030-ba2f-43370f303fad tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] [instance: 93775f02-e62c-4392-a1ed-cfd5dd956dd7] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:38.906005 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-0d0e0989-873a-4030-ba2f-43370f303fad tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:38.906477 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-0d0e0989-873a-4030-ba2f-43370f303fad tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:38.907281 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-0d0e0989-873a-4030-ba2f-43370f303fad tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:38.907744 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-0d0e0989-873a-4030-ba2f-43370f303fad tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:38.994812 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.objects.instance [None req-0d0e0989-873a-4030-ba2f-43370f303fad tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lazy-loading 'services' on Instance uuid 93775f02-e62c-4392-a1ed-cfd5dd956dd7 {{(pid=129952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 11:01:39.230429 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-0d0e0989-873a-4030-ba2f-43370f303fad tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] 10.222.0.115 "DELETE /compute/v2.1/servers/93775f02-e62c-4392-a1ed-cfd5dd956dd7/os-volume_attachments/4cf32135-1022-4abf-83f5-94139c1da0e7" status: 202 len: 0 microversion: 2.1 time: 0.333875 Aug 02 11:01:39.230429 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 406/822] 10.222.0.115 () {58 vars in 1421 bytes} [Tue Aug 2 11:01:38 2022] DELETE /compute/v2.1/servers/93775f02-e62c-4392-a1ed-cfd5dd956dd7/os-volume_attachments/4cf32135-1022-4abf-83f5-94139c1da0e7 => generated 0 bytes in 335 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 11:01:39.901161 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-c44d89f0-d335-409d-b938-9d2334766363 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:39.904320 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-c44d89f0-d335-409d-b938-9d2334766363 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: 07d63415-e151-4b2f-93ff-0769c401f16b] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:39.912788 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-c44d89f0-d335-409d-b938-9d2334766363 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:39.913622 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-c44d89f0-d335-409d-b938-9d2334766363 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:39.914652 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-c44d89f0-d335-409d-b938-9d2334766363 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:39.915345 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-c44d89f0-d335-409d-b938-9d2334766363 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:39.939667 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG dbcounter [-] [129953] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=129953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 11:01:39.954380 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-c44d89f0-d335-409d-b938-9d2334766363 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "GET /compute/v2.1/servers/07d63415-e151-4b2f-93ff-0769c401f16b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057434 Aug 02 11:01:39.959528 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 417/823] 10.222.0.115 () {58 vars in 1307 bytes} [Tue Aug 2 11:01:39 2022] GET /compute/v2.1/servers/07d63415-e151-4b2f-93ff-0769c401f16b/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 11:01:40.968810 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-97b1f0ad-9c6e-41fb-a16e-f95bba4a02de tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:40.971290 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-97b1f0ad-9c6e-41fb-a16e-f95bba4a02de tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: 07d63415-e151-4b2f-93ff-0769c401f16b] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:40.979304 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-97b1f0ad-9c6e-41fb-a16e-f95bba4a02de tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:40.980038 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-97b1f0ad-9c6e-41fb-a16e-f95bba4a02de tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:40.980836 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-97b1f0ad-9c6e-41fb-a16e-f95bba4a02de tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:40.981275 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-97b1f0ad-9c6e-41fb-a16e-f95bba4a02de tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:41.011852 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-97b1f0ad-9c6e-41fb-a16e-f95bba4a02de tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "GET /compute/v2.1/servers/07d63415-e151-4b2f-93ff-0769c401f16b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048371 Aug 02 11:01:41.012974 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 407/824] 10.222.0.115 () {58 vars in 1307 bytes} [Tue Aug 2 11:01:40 2022] GET /compute/v2.1/servers/07d63415-e151-4b2f-93ff-0769c401f16b/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 11:01:41.082333 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-c6bd6665-d174-4293-bf8f-b09c31ae5d91 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:41.082907 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-c6bd6665-d174-4293-bf8f-b09c31ae5d91 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: 07d63415-e151-4b2f-93ff-0769c401f16b] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:41.089988 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-c6bd6665-d174-4293-bf8f-b09c31ae5d91 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:41.090980 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-c6bd6665-d174-4293-bf8f-b09c31ae5d91 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:41.091788 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-c6bd6665-d174-4293-bf8f-b09c31ae5d91 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:41.092225 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-c6bd6665-d174-4293-bf8f-b09c31ae5d91 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:41.119317 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-c6bd6665-d174-4293-bf8f-b09c31ae5d91 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: 07d63415-e151-4b2f-93ff-0769c401f16b] Going to try to terminate instance {{(pid=129953) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 11:01:41.367788 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-c6bd6665-d174-4293-bf8f-b09c31ae5d91 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "DELETE /compute/v2.1/servers/07d63415-e151-4b2f-93ff-0769c401f16b" status: 204 len: 0 microversion: 2.1 time: 0.289355 Aug 02 11:01:41.372619 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 418/825] 10.222.0.115 () {58 vars in 1244 bytes} [Tue Aug 2 11:01:41 2022] DELETE /compute/v2.1/servers/07d63415-e151-4b2f-93ff-0769c401f16b => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 11:01:41.393163 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-a1d33472-93d1-4c83-a290-7db52d83b38f tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:41.393837 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-a1d33472-93d1-4c83-a290-7db52d83b38f tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: 07d63415-e151-4b2f-93ff-0769c401f16b] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:41.404723 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-a1d33472-93d1-4c83-a290-7db52d83b38f tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:41.412048 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-a1d33472-93d1-4c83-a290-7db52d83b38f tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:41.412048 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-a1d33472-93d1-4c83-a290-7db52d83b38f tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:41.412048 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-a1d33472-93d1-4c83-a290-7db52d83b38f tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:41.540559 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-98e2e7d0-6d60-4368-85f5-8d9ad6313e08 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:41.543173 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-98e2e7d0-6d60-4368-85f5-8d9ad6313e08 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] [instance: 93775f02-e62c-4392-a1ed-cfd5dd956dd7] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:41.550748 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-98e2e7d0-6d60-4368-85f5-8d9ad6313e08 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:41.551365 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-98e2e7d0-6d60-4368-85f5-8d9ad6313e08 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:41.552393 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-98e2e7d0-6d60-4368-85f5-8d9ad6313e08 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:41.554668 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-98e2e7d0-6d60-4368-85f5-8d9ad6313e08 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:41.592858 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-98e2e7d0-6d60-4368-85f5-8d9ad6313e08 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] 10.222.0.115 "GET /compute/v2.1/servers/93775f02-e62c-4392-a1ed-cfd5dd956dd7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056770 Aug 02 11:01:41.593951 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 419/826] 10.222.0.115 () {58 vars in 1307 bytes} [Tue Aug 2 11:01:41 2022] GET /compute/v2.1/servers/93775f02-e62c-4392-a1ed-cfd5dd956dd7/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 02 11:01:41.669538 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-a1d33472-93d1-4c83-a290-7db52d83b38f tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bc14ada1564911b2f0a698aef3f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a4a0cf1852449e8bfc59ddb5a902c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:01:41.677696 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-a1d33472-93d1-4c83-a290-7db52d83b38f tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "GET /compute/v2.1/servers/07d63415-e151-4b2f-93ff-0769c401f16b" status: 200 len: 1687 microversion: 2.1 time: 0.303805 Aug 02 11:01:41.680365 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 408/827] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:01:41 2022] GET /compute/v2.1/servers/07d63415-e151-4b2f-93ff-0769c401f16b => generated 1687 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:01:41.718951 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-94d12911-9844-4533-8b48-a36acfe222e5 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:41.721071 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-94d12911-9844-4533-8b48-a36acfe222e5 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] [instance: 93775f02-e62c-4392-a1ed-cfd5dd956dd7] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:41.727439 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-94d12911-9844-4533-8b48-a36acfe222e5 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:41.728292 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-94d12911-9844-4533-8b48-a36acfe222e5 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:41.729236 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-94d12911-9844-4533-8b48-a36acfe222e5 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:41.729880 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-94d12911-9844-4533-8b48-a36acfe222e5 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:41.770404 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-94d12911-9844-4533-8b48-a36acfe222e5 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] 10.222.0.115 "GET /compute/v2.1/servers/93775f02-e62c-4392-a1ed-cfd5dd956dd7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055541 Aug 02 11:01:41.773049 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 420/828] 10.222.0.115 () {58 vars in 1307 bytes} [Tue Aug 2 11:01:41 2022] GET /compute/v2.1/servers/93775f02-e62c-4392-a1ed-cfd5dd956dd7/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 11:01:41.836512 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-ba020eb2-d3d8-4f42-9b72-2d19a960d3d8 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:41.837004 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-ba020eb2-d3d8-4f42-9b72-2d19a960d3d8 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] [instance: 93775f02-e62c-4392-a1ed-cfd5dd956dd7] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:41.844686 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-ba020eb2-d3d8-4f42-9b72-2d19a960d3d8 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:41.845125 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-ba020eb2-d3d8-4f42-9b72-2d19a960d3d8 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:41.845911 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-ba020eb2-d3d8-4f42-9b72-2d19a960d3d8 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:41.846360 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-ba020eb2-d3d8-4f42-9b72-2d19a960d3d8 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:41.872880 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-ba020eb2-d3d8-4f42-9b72-2d19a960d3d8 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] [instance: 93775f02-e62c-4392-a1ed-cfd5dd956dd7] Going to try to terminate instance {{(pid=129952) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 11:01:42.173221 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-ba020eb2-d3d8-4f42-9b72-2d19a960d3d8 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] 10.222.0.115 "DELETE /compute/v2.1/servers/93775f02-e62c-4392-a1ed-cfd5dd956dd7" status: 204 len: 0 microversion: 2.1 time: 0.340563 Aug 02 11:01:42.173935 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 409/829] 10.222.0.115 () {58 vars in 1244 bytes} [Tue Aug 2 11:01:41 2022] DELETE /compute/v2.1/servers/93775f02-e62c-4392-a1ed-cfd5dd956dd7 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 11:01:42.182126 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-9ce7976c-188b-47a5-b3dd-30244ad98ed7 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:42.182732 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-9ce7976c-188b-47a5-b3dd-30244ad98ed7 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] [instance: 93775f02-e62c-4392-a1ed-cfd5dd956dd7] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:42.189583 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-9ce7976c-188b-47a5-b3dd-30244ad98ed7 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:42.190026 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-9ce7976c-188b-47a5-b3dd-30244ad98ed7 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:42.190999 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-9ce7976c-188b-47a5-b3dd-30244ad98ed7 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:42.191592 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-9ce7976c-188b-47a5-b3dd-30244ad98ed7 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:42.333345 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-9ce7976c-188b-47a5-b3dd-30244ad98ed7 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f41f17f5154e01a699043edc350cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e92110a1545f1b84644b8971bb6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:01:42.341876 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-9ce7976c-188b-47a5-b3dd-30244ad98ed7 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] 10.222.0.115 "GET /compute/v2.1/servers/93775f02-e62c-4392-a1ed-cfd5dd956dd7" status: 200 len: 1675 microversion: 2.1 time: 0.163667 Aug 02 11:01:42.342450 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 421/830] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:01:42 2022] GET /compute/v2.1/servers/93775f02-e62c-4392-a1ed-cfd5dd956dd7 => generated 1675 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:01:42.701933 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-4dfb7884-de08-49ac-9bc4-e705d30ce7e1 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:42.702661 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-4dfb7884-de08-49ac-9bc4-e705d30ce7e1 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: 07d63415-e151-4b2f-93ff-0769c401f16b] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:42.704672 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG dbcounter [-] [129952] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1 {{(pid=129952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 11:01:42.709502 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-4dfb7884-de08-49ac-9bc4-e705d30ce7e1 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:42.711737 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-4dfb7884-de08-49ac-9bc4-e705d30ce7e1 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:42.711737 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-4dfb7884-de08-49ac-9bc4-e705d30ce7e1 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:42.711737 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-4dfb7884-de08-49ac-9bc4-e705d30ce7e1 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:42.851493 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-4dfb7884-de08-49ac-9bc4-e705d30ce7e1 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bc14ada1564911b2f0a698aef3f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a4a0cf1852449e8bfc59ddb5a902c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:01:42.859149 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-4dfb7884-de08-49ac-9bc4-e705d30ce7e1 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "GET /compute/v2.1/servers/07d63415-e151-4b2f-93ff-0769c401f16b" status: 200 len: 1687 microversion: 2.1 time: 0.162148 Aug 02 11:01:42.859795 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 410/831] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:01:42 2022] GET /compute/v2.1/servers/07d63415-e151-4b2f-93ff-0769c401f16b => generated 1687 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:01:43.363985 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-65362f05-7f75-407a-bc9f-e469faaad8f7 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:43.364860 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-65362f05-7f75-407a-bc9f-e469faaad8f7 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] [instance: 93775f02-e62c-4392-a1ed-cfd5dd956dd7] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:43.372247 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-65362f05-7f75-407a-bc9f-e469faaad8f7 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:43.372702 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-65362f05-7f75-407a-bc9f-e469faaad8f7 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:43.373603 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-65362f05-7f75-407a-bc9f-e469faaad8f7 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:43.374249 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-65362f05-7f75-407a-bc9f-e469faaad8f7 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:43.516278 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-65362f05-7f75-407a-bc9f-e469faaad8f7 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f41f17f5154e01a699043edc350cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e92110a1545f1b84644b8971bb6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:01:43.524203 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-65362f05-7f75-407a-bc9f-e469faaad8f7 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] 10.222.0.115 "GET /compute/v2.1/servers/93775f02-e62c-4392-a1ed-cfd5dd956dd7" status: 200 len: 1675 microversion: 2.1 time: 0.164087 Aug 02 11:01:43.524760 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 422/832] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:01:43 2022] GET /compute/v2.1/servers/93775f02-e62c-4392-a1ed-cfd5dd956dd7 => generated 1675 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:01:43.807391 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-4e69b65f-35f1-43c1-a2f3-64381c200e51 tempest-VolumesSnapshotsTestJSON-655782843 tempest-VolumesSnapshotsTestJSON-655782843-project] Action: 'create', calling method: .version_select at 0x7f7c4ec5d700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1135247119"}} {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 11:01:43.881425 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-306c5c32-c4d8-496e-bf02-b23e2c5ea3ab tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:43.882039 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-306c5c32-c4d8-496e-bf02-b23e2c5ea3ab tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: 07d63415-e151-4b2f-93ff-0769c401f16b] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:43.888685 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-306c5c32-c4d8-496e-bf02-b23e2c5ea3ab tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:43.889133 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-306c5c32-c4d8-496e-bf02-b23e2c5ea3ab tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:43.889896 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-306c5c32-c4d8-496e-bf02-b23e2c5ea3ab tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:43.890328 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-306c5c32-c4d8-496e-bf02-b23e2c5ea3ab tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:44.029066 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-306c5c32-c4d8-496e-bf02-b23e2c5ea3ab tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bc14ada1564911b2f0a698aef3f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a4a0cf1852449e8bfc59ddb5a902c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:01:44.038811 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-306c5c32-c4d8-496e-bf02-b23e2c5ea3ab tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "GET /compute/v2.1/servers/07d63415-e151-4b2f-93ff-0769c401f16b" status: 200 len: 1687 microversion: 2.1 time: 0.161111 Aug 02 11:01:44.039552 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 423/833] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:01:43 2022] GET /compute/v2.1/servers/07d63415-e151-4b2f-93ff-0769c401f16b => generated 1687 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 11:01:44.437770 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-4e69b65f-35f1-43c1-a2f3-64381c200e51 tempest-VolumesSnapshotsTestJSON-655782843 tempest-VolumesSnapshotsTestJSON-655782843-project] 10.222.0.115 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.742910 Aug 02 11:01:44.438388 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 411/834] 10.222.0.115 () {60 vars in 1160 bytes} [Tue Aug 2 11:01:43 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 744 msecs (HTTP/1.1 200) 10 headers in 449 bytes (1 switches on core 0) Aug 02 11:01:44.450952 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-e1659d04-6173-41c1-b155-d319568d8de0 tempest-VolumesSnapshotsTestJSON-655782843 tempest-VolumesSnapshotsTestJSON-655782843-project] Calling method '.version_select at 0x7f7c540e5f70>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:44.508167 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-e1659d04-6173-41c1-b155-d319568d8de0 tempest-VolumesSnapshotsTestJSON-655782843 tempest-VolumesSnapshotsTestJSON-655782843-project] 10.222.0.115 "GET /compute/v2.1/os-volumes/5959c0d4-acd7-4659-9c0f-2a246d786911" status: 200 len: 345 microversion: 2.1 time: 0.061080 Aug 02 11:01:44.508797 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 424/835] 10.222.0.115 () {58 vars in 1250 bytes} [Tue Aug 2 11:01:44 2022] GET /compute/v2.1/os-volumes/5959c0d4-acd7-4659-9c0f-2a246d786911 => generated 345 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 11:01:44.549668 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-84ffce24-f756-4856-9037-5f146eb47cc9 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:44.550528 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-84ffce24-f756-4856-9037-5f146eb47cc9 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] [instance: 93775f02-e62c-4392-a1ed-cfd5dd956dd7] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:44.557220 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-84ffce24-f756-4856-9037-5f146eb47cc9 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:44.560421 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-84ffce24-f756-4856-9037-5f146eb47cc9 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:44.560421 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-84ffce24-f756-4856-9037-5f146eb47cc9 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:44.560421 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-84ffce24-f756-4856-9037-5f146eb47cc9 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:44.696563 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-84ffce24-f756-4856-9037-5f146eb47cc9 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f41f17f5154e01a699043edc350cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e92110a1545f1b84644b8971bb6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:01:44.704834 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-84ffce24-f756-4856-9037-5f146eb47cc9 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] 10.222.0.115 "GET /compute/v2.1/servers/93775f02-e62c-4392-a1ed-cfd5dd956dd7" status: 200 len: 1675 microversion: 2.1 time: 0.158991 Aug 02 11:01:44.705395 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 412/836] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:01:44 2022] GET /compute/v2.1/servers/93775f02-e62c-4392-a1ed-cfd5dd956dd7 => generated 1675 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:01:45.061412 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-fef9338b-083e-4cd8-899b-8f163b41f181 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:45.062014 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-fef9338b-083e-4cd8-899b-8f163b41f181 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: 07d63415-e151-4b2f-93ff-0769c401f16b] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:45.068215 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-fef9338b-083e-4cd8-899b-8f163b41f181 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:45.068654 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-fef9338b-083e-4cd8-899b-8f163b41f181 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:45.069402 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-fef9338b-083e-4cd8-899b-8f163b41f181 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:45.069831 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-fef9338b-083e-4cd8-899b-8f163b41f181 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:45.205721 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-fef9338b-083e-4cd8-899b-8f163b41f181 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bc14ada1564911b2f0a698aef3f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a4a0cf1852449e8bfc59ddb5a902c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:01:45.213533 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-fef9338b-083e-4cd8-899b-8f163b41f181 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "GET /compute/v2.1/servers/07d63415-e151-4b2f-93ff-0769c401f16b" status: 200 len: 1687 microversion: 2.1 time: 0.156101 Aug 02 11:01:45.214037 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 425/837] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:01:45 2022] GET /compute/v2.1/servers/07d63415-e151-4b2f-93ff-0769c401f16b => generated 1687 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:01:45.523371 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-33f6dd34-f002-41bf-993e-cecaeff89069 tempest-VolumesSnapshotsTestJSON-655782843 tempest-VolumesSnapshotsTestJSON-655782843-project] Calling method '.version_select at 0x7f7c4ec123a0>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:45.572613 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-33f6dd34-f002-41bf-993e-cecaeff89069 tempest-VolumesSnapshotsTestJSON-655782843 tempest-VolumesSnapshotsTestJSON-655782843-project] 10.222.0.115 "GET /compute/v2.1/os-volumes/5959c0d4-acd7-4659-9c0f-2a246d786911" status: 200 len: 346 microversion: 2.1 time: 0.053016 Aug 02 11:01:45.573306 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 413/838] 10.222.0.115 () {58 vars in 1250 bytes} [Tue Aug 2 11:01:45 2022] GET /compute/v2.1/os-volumes/5959c0d4-acd7-4659-9c0f-2a246d786911 => generated 346 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 11:01:45.587499 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-a85b00b6-c51e-4405-ad39-5eab6b770162 tempest-VolumesSnapshotsTestJSON-655782843 tempest-VolumesSnapshotsTestJSON-655782843-project] Action: 'create', calling method: .version_select at 0x7f7c4e4d9820>, body: {"snapshot": {"volume_id": "5959c0d4-acd7-4659-9c0f-2a246d786911", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1237777505"}} {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 11:01:45.727963 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-aa87b4c3-98b8-42ea-a047-aab0789c733c tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:45.729067 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-aa87b4c3-98b8-42ea-a047-aab0789c733c tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] [instance: 93775f02-e62c-4392-a1ed-cfd5dd956dd7] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:45.738439 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-aa87b4c3-98b8-42ea-a047-aab0789c733c tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:45.739184 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-aa87b4c3-98b8-42ea-a047-aab0789c733c tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:45.740473 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-aa87b4c3-98b8-42ea-a047-aab0789c733c tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:45.741095 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-aa87b4c3-98b8-42ea-a047-aab0789c733c tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:46.116529 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-a85b00b6-c51e-4405-ad39-5eab6b770162 tempest-VolumesSnapshotsTestJSON-655782843 tempest-VolumesSnapshotsTestJSON-655782843-project] 10.222.0.115 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.533151 Aug 02 11:01:46.117555 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 426/839] 10.222.0.115 () {60 vars in 1167 bytes} [Tue Aug 2 11:01:45 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 11:01:46.129836 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-9349f39d-a844-41a6-b6fa-50fb4160f530 tempest-VolumesSnapshotsTestJSON-655782843 tempest-VolumesSnapshotsTestJSON-655782843-project] Calling method '.version_select at 0x7f7c4e4f6b80>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:46.161936 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-aa87b4c3-98b8-42ea-a047-aab0789c733c tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f41f17f5154e01a699043edc350cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e92110a1545f1b84644b8971bb6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:01:46.181136 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-9349f39d-a844-41a6-b6fa-50fb4160f530 tempest-VolumesSnapshotsTestJSON-655782843 tempest-VolumesSnapshotsTestJSON-655782843-project] 10.222.0.115 "GET /compute/v2.1/os-snapshots/a795e9af-ce3b-4a91-92aa-6a7c5c5790b2" status: 200 len: 287 microversion: 2.1 time: 0.055392 Aug 02 11:01:46.184704 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-aa87b4c3-98b8-42ea-a047-aab0789c733c tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] 10.222.0.115 "GET /compute/v2.1/servers/93775f02-e62c-4392-a1ed-cfd5dd956dd7" status: 200 len: 1675 microversion: 2.1 time: 0.461125 Aug 02 11:01:46.185781 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 427/840] 10.222.0.115 () {58 vars in 1256 bytes} [Tue Aug 2 11:01:46 2022] GET /compute/v2.1/os-snapshots/a795e9af-ce3b-4a91-92aa-6a7c5c5790b2 => generated 287 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 11:01:46.188348 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 414/841] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:01:45 2022] GET /compute/v2.1/servers/93775f02-e62c-4392-a1ed-cfd5dd956dd7 => generated 1675 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:01:46.205440 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-1bc8dd84-3372-4ea1-acd3-ddb864521a31 tempest-VolumesSnapshotsTestJSON-655782843 tempest-VolumesSnapshotsTestJSON-655782843-project] Calling method '.version_select at 0x7f7c540e5f70>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:46.243814 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-1bc8dd84-3372-4ea1-acd3-ddb864521a31 tempest-VolumesSnapshotsTestJSON-655782843 tempest-VolumesSnapshotsTestJSON-655782843-project] 10.222.0.115 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.050349 Aug 02 11:01:46.244435 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 428/842] 10.222.0.115 () {58 vars in 1145 bytes} [Tue Aug 2 11:01:46 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 11:01:46.244880 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-2fe0134f-8a8d-4958-b9e3-dcaecf9ce45c tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:46.245861 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-2fe0134f-8a8d-4958-b9e3-dcaecf9ce45c tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: 07d63415-e151-4b2f-93ff-0769c401f16b] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:46.256301 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-48214582-9d2d-4fa1-8c6e-bf5cd4f045a9 tempest-VolumesSnapshotsTestJSON-655782843 tempest-VolumesSnapshotsTestJSON-655782843-project] Calling method '.version_select at 0x7f7c5768c940>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:46.257506 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-2fe0134f-8a8d-4958-b9e3-dcaecf9ce45c tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:46.257962 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-2fe0134f-8a8d-4958-b9e3-dcaecf9ce45c tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:46.258742 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-2fe0134f-8a8d-4958-b9e3-dcaecf9ce45c tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:46.259650 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-2fe0134f-8a8d-4958-b9e3-dcaecf9ce45c tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:46.289304 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-48214582-9d2d-4fa1-8c6e-bf5cd4f045a9 tempest-VolumesSnapshotsTestJSON-655782843 tempest-VolumesSnapshotsTestJSON-655782843-project] 10.222.0.115 "GET /compute/v2.1/os-snapshots/a795e9af-ce3b-4a91-92aa-6a7c5c5790b2" status: 200 len: 287 microversion: 2.1 time: 0.036867 Aug 02 11:01:46.289884 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 429/843] 10.222.0.115 () {58 vars in 1256 bytes} [Tue Aug 2 11:01:46 2022] GET /compute/v2.1/os-snapshots/a795e9af-ce3b-4a91-92aa-6a7c5c5790b2 => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 11:01:46.348818 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-2fe0134f-8a8d-4958-b9e3-dcaecf9ce45c tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bc14ada1564911b2f0a698aef3f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a4a0cf1852449e8bfc59ddb5a902c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:01:46.357684 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-2fe0134f-8a8d-4958-b9e3-dcaecf9ce45c tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "GET /compute/v2.1/servers/07d63415-e151-4b2f-93ff-0769c401f16b" status: 200 len: 1619 microversion: 2.1 time: 0.125494 Aug 02 11:01:46.358495 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 415/844] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:01:46 2022] GET /compute/v2.1/servers/07d63415-e151-4b2f-93ff-0769c401f16b => generated 1619 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:01:46.489372 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [req-5a28b4a3-7819-4ae1-8ecf-ad70eb9e88e8 req-8f0fca5b-ecb5-4c0c-b665-bd915ea16a99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07d63415-e151-4b2f-93ff-0769c401f16b", "name": "network-vif-deleted", "tag": "4e1594b0-146d-4aca-806b-5d9b5a8ab2c1"}]} {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 11:01:46.499447 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [req-5a28b4a3-7819-4ae1-8ecf-ad70eb9e88e8 req-8f0fca5b-ecb5-4c0c-b665-bd915ea16a99 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:46.499892 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [req-5a28b4a3-7819-4ae1-8ecf-ad70eb9e88e8 req-8f0fca5b-ecb5-4c0c-b665-bd915ea16a99 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:46.514067 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.compute.server_external_events [req-5a28b4a3-7819-4ae1-8ecf-ad70eb9e88e8 req-8f0fca5b-ecb5-4c0c-b665-bd915ea16a99 service nova] Creating event network-vif-deleted:4e1594b0-146d-4aca-806b-5d9b5a8ab2c1 for instance 07d63415-e151-4b2f-93ff-0769c401f16b on hv-cinder-85031 Aug 02 11:01:46.519335 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [req-5a28b4a3-7819-4ae1-8ecf-ad70eb9e88e8 req-8f0fca5b-ecb5-4c0c-b665-bd915ea16a99 service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033550 Aug 02 11:01:46.522963 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 430/845] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Aug 2 11:01:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 11:01:47.155629 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [req-65d383b2-e703-405d-a201-8291c825708e req-768a04e6-90ac-4ed5-af33-40b4bae3453a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93775f02-e62c-4392-a1ed-cfd5dd956dd7", "name": "network-vif-deleted", "tag": "571a2e00-abb0-4402-8c1a-59fe26898cf1"}]} {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 11:01:47.170389 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [req-65d383b2-e703-405d-a201-8291c825708e req-768a04e6-90ac-4ed5-af33-40b4bae3453a service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:47.171133 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [req-65d383b2-e703-405d-a201-8291c825708e req-768a04e6-90ac-4ed5-af33-40b4bae3453a service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:47.184548 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.compute.server_external_events [req-65d383b2-e703-405d-a201-8291c825708e req-768a04e6-90ac-4ed5-af33-40b4bae3453a service nova] Creating event network-vif-deleted:571a2e00-abb0-4402-8c1a-59fe26898cf1 for instance 93775f02-e62c-4392-a1ed-cfd5dd956dd7 on hv-cinder-85031 Aug 02 11:01:47.189827 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [req-65d383b2-e703-405d-a201-8291c825708e req-768a04e6-90ac-4ed5-af33-40b4bae3453a service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038094 Aug 02 11:01:47.190817 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 416/846] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Aug 2 11:01:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 11:01:47.212273 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-fbf88216-ae3e-4f2e-8aff-22a9dd781d6c tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:47.213642 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-fbf88216-ae3e-4f2e-8aff-22a9dd781d6c tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] [instance: 93775f02-e62c-4392-a1ed-cfd5dd956dd7] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:47.221262 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-fbf88216-ae3e-4f2e-8aff-22a9dd781d6c tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:47.221712 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-fbf88216-ae3e-4f2e-8aff-22a9dd781d6c tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:47.223651 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-fbf88216-ae3e-4f2e-8aff-22a9dd781d6c tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:47.223651 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-fbf88216-ae3e-4f2e-8aff-22a9dd781d6c tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:47.304895 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-fbf88216-ae3e-4f2e-8aff-22a9dd781d6c tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f41f17f5154e01a699043edc350cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e92110a1545f1b84644b8971bb6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:01:47.305503 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-026eb0b5-be8a-473f-baf7-f23dee10427c tempest-VolumesSnapshotsTestJSON-655782843 tempest-VolumesSnapshotsTestJSON-655782843-project] Calling method '.version_select at 0x7f7c4ec998b0>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:47.312785 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-fbf88216-ae3e-4f2e-8aff-22a9dd781d6c tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] 10.222.0.115 "GET /compute/v2.1/servers/93775f02-e62c-4392-a1ed-cfd5dd956dd7" status: 200 len: 1608 microversion: 2.1 time: 0.107259 Aug 02 11:01:47.325258 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 431/847] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:01:47 2022] GET /compute/v2.1/servers/93775f02-e62c-4392-a1ed-cfd5dd956dd7 => generated 1608 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:01:47.342356 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-026eb0b5-be8a-473f-baf7-f23dee10427c tempest-VolumesSnapshotsTestJSON-655782843 tempest-VolumesSnapshotsTestJSON-655782843-project] 10.222.0.115 "GET /compute/v2.1/os-snapshots/a795e9af-ce3b-4a91-92aa-6a7c5c5790b2" status: 200 len: 287 microversion: 2.1 time: 0.042387 Aug 02 11:01:47.343340 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 417/848] 10.222.0.115 () {58 vars in 1256 bytes} [Tue Aug 2 11:01:47 2022] GET /compute/v2.1/os-snapshots/a795e9af-ce3b-4a91-92aa-6a7c5c5790b2 => generated 287 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 11:01:47.380216 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-f417593c-c44b-4fbd-bc9d-c0401bc9058c tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:47.380828 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-f417593c-c44b-4fbd-bc9d-c0401bc9058c tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: 07d63415-e151-4b2f-93ff-0769c401f16b] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:47.389261 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-f417593c-c44b-4fbd-bc9d-c0401bc9058c tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:47.389713 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-f417593c-c44b-4fbd-bc9d-c0401bc9058c tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:47.390492 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-f417593c-c44b-4fbd-bc9d-c0401bc9058c tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:47.391164 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-f417593c-c44b-4fbd-bc9d-c0401bc9058c tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:47.467417 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-f417593c-c44b-4fbd-bc9d-c0401bc9058c tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bc14ada1564911b2f0a698aef3f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a4a0cf1852449e8bfc59ddb5a902c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:01:47.478297 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-f417593c-c44b-4fbd-bc9d-c0401bc9058c tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "GET /compute/v2.1/servers/07d63415-e151-4b2f-93ff-0769c401f16b" status: 200 len: 1330 microversion: 2.1 time: 0.102046 Aug 02 11:01:47.483105 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 432/849] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:01:47 2022] GET /compute/v2.1/servers/07d63415-e151-4b2f-93ff-0769c401f16b => generated 1330 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:01:48.347789 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-6d20faad-944d-49e8-98d1-d2dd912ff9b8 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:48.348455 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-6d20faad-944d-49e8-98d1-d2dd912ff9b8 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] [instance: 93775f02-e62c-4392-a1ed-cfd5dd956dd7] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:48.355211 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-07d1aadb-42ae-42fe-9a1f-38cc356487a3 tempest-VolumesSnapshotsTestJSON-655782843 tempest-VolumesSnapshotsTestJSON-655782843-project] Calling method '.version_select at 0x7f7c5768ce50>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:48.360651 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-6d20faad-944d-49e8-98d1-d2dd912ff9b8 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:48.360651 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-6d20faad-944d-49e8-98d1-d2dd912ff9b8 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:48.360651 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-6d20faad-944d-49e8-98d1-d2dd912ff9b8 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:48.360651 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-6d20faad-944d-49e8-98d1-d2dd912ff9b8 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:48.385980 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-07d1aadb-42ae-42fe-9a1f-38cc356487a3 tempest-VolumesSnapshotsTestJSON-655782843 tempest-VolumesSnapshotsTestJSON-655782843-project] 10.222.0.115 "GET /compute/v2.1/os-snapshots/a795e9af-ce3b-4a91-92aa-6a7c5c5790b2" status: 200 len: 287 microversion: 2.1 time: 0.034547 Aug 02 11:01:48.386555 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 433/850] 10.222.0.115 () {58 vars in 1256 bytes} [Tue Aug 2 11:01:48 2022] GET /compute/v2.1/os-snapshots/a795e9af-ce3b-4a91-92aa-6a7c5c5790b2 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 11:01:48.431284 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-6d20faad-944d-49e8-98d1-d2dd912ff9b8 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f41f17f5154e01a699043edc350cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e92110a1545f1b84644b8971bb6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:01:48.439272 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-6d20faad-944d-49e8-98d1-d2dd912ff9b8 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] 10.222.0.115 "GET /compute/v2.1/servers/93775f02-e62c-4392-a1ed-cfd5dd956dd7" status: 200 len: 1608 microversion: 2.1 time: 0.095956 Aug 02 11:01:48.440035 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 418/851] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:01:48 2022] GET /compute/v2.1/servers/93775f02-e62c-4392-a1ed-cfd5dd956dd7 => generated 1608 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:01:48.501795 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-d3f147ce-4236-4932-8fc2-8189a3a4a3af tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:48.502405 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-d3f147ce-4236-4932-8fc2-8189a3a4a3af tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: 07d63415-e151-4b2f-93ff-0769c401f16b] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:48.508506 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-d3f147ce-4236-4932-8fc2-8189a3a4a3af tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:48.508953 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-d3f147ce-4236-4932-8fc2-8189a3a4a3af tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:48.509703 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-d3f147ce-4236-4932-8fc2-8189a3a4a3af tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:48.510161 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-d3f147ce-4236-4932-8fc2-8189a3a4a3af tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:48.571977 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-d3f147ce-4236-4932-8fc2-8189a3a4a3af tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bc14ada1564911b2f0a698aef3f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a4a0cf1852449e8bfc59ddb5a902c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:01:48.580037 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-d3f147ce-4236-4932-8fc2-8189a3a4a3af tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "GET /compute/v2.1/servers/07d63415-e151-4b2f-93ff-0769c401f16b" status: 200 len: 1330 microversion: 2.1 time: 0.082210 Aug 02 11:01:48.580613 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 434/852] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:01:48 2022] GET /compute/v2.1/servers/07d63415-e151-4b2f-93ff-0769c401f16b => generated 1330 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:01:49.398967 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-246cf0d4-e9b1-431b-b68c-488d07099519 tempest-VolumesSnapshotsTestJSON-655782843 tempest-VolumesSnapshotsTestJSON-655782843-project] Calling method '.version_select at 0x7f7c4ec12f70>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:49.435940 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-246cf0d4-e9b1-431b-b68c-488d07099519 tempest-VolumesSnapshotsTestJSON-655782843 tempest-VolumesSnapshotsTestJSON-655782843-project] 10.222.0.115 "GET /compute/v2.1/os-snapshots/a795e9af-ce3b-4a91-92aa-6a7c5c5790b2" status: 200 len: 287 microversion: 2.1 time: 0.040466 Aug 02 11:01:49.443182 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 419/853] 10.222.0.115 () {58 vars in 1256 bytes} [Tue Aug 2 11:01:49 2022] GET /compute/v2.1/os-snapshots/a795e9af-ce3b-4a91-92aa-6a7c5c5790b2 => generated 287 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 11:01:49.461629 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-138d7743-42f0-409f-abed-4be25eeb9258 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:49.462237 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-138d7743-42f0-409f-abed-4be25eeb9258 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] [instance: 93775f02-e62c-4392-a1ed-cfd5dd956dd7] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:49.470251 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-138d7743-42f0-409f-abed-4be25eeb9258 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:49.470810 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-138d7743-42f0-409f-abed-4be25eeb9258 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:49.471647 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-138d7743-42f0-409f-abed-4be25eeb9258 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:49.472119 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-138d7743-42f0-409f-abed-4be25eeb9258 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:49.535279 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-138d7743-42f0-409f-abed-4be25eeb9258 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f41f17f5154e01a699043edc350cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e92110a1545f1b84644b8971bb6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:01:49.545916 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-138d7743-42f0-409f-abed-4be25eeb9258 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] 10.222.0.115 "GET /compute/v2.1/servers/93775f02-e62c-4392-a1ed-cfd5dd956dd7" status: 200 len: 1325 microversion: 2.1 time: 0.087857 Aug 02 11:01:49.546420 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 435/854] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:01:49 2022] GET /compute/v2.1/servers/93775f02-e62c-4392-a1ed-cfd5dd956dd7 => generated 1325 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 11:01:49.601677 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-a2c14606-372b-4777-9068-2fd5182499c9 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:49.602351 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-a2c14606-372b-4777-9068-2fd5182499c9 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: 07d63415-e151-4b2f-93ff-0769c401f16b] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:49.609772 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-a2c14606-372b-4777-9068-2fd5182499c9 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:49.610218 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-a2c14606-372b-4777-9068-2fd5182499c9 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:49.610976 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-a2c14606-372b-4777-9068-2fd5182499c9 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:49.611510 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-a2c14606-372b-4777-9068-2fd5182499c9 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:49.642637 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-a2c14606-372b-4777-9068-2fd5182499c9 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:49.643111 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-a2c14606-372b-4777-9068-2fd5182499c9 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:49.643562 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.objects.instance [None req-a2c14606-372b-4777-9068-2fd5182499c9 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lazy-loading 'fault' on Instance uuid 07d63415-e151-4b2f-93ff-0769c401f16b {{(pid=129952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 11:01:49.685601 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-a2c14606-372b-4777-9068-2fd5182499c9 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bc14ada1564911b2f0a698aef3f333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a4a0cf1852449e8bfc59ddb5a902c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:01:49.693117 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-a2c14606-372b-4777-9068-2fd5182499c9 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "GET /compute/v2.1/servers/07d63415-e151-4b2f-93ff-0769c401f16b" status: 200 len: 1335 microversion: 2.1 time: 0.095297 Aug 02 11:01:49.693697 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 420/855] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:01:49 2022] GET /compute/v2.1/servers/07d63415-e151-4b2f-93ff-0769c401f16b => generated 1335 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:01:50.449891 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-4f8a3a3c-f0c2-453f-a700-414ce7854690 tempest-VolumesSnapshotsTestJSON-655782843 tempest-VolumesSnapshotsTestJSON-655782843-project] Calling method '.version_select at 0x7f7c5768c0d0>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:50.479958 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-4f8a3a3c-f0c2-453f-a700-414ce7854690 tempest-VolumesSnapshotsTestJSON-655782843 tempest-VolumesSnapshotsTestJSON-655782843-project] 10.222.0.115 "GET /compute/v2.1/os-snapshots/a795e9af-ce3b-4a91-92aa-6a7c5c5790b2" status: 200 len: 288 microversion: 2.1 time: 0.035077 Aug 02 11:01:50.482180 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 436/856] 10.222.0.115 () {58 vars in 1256 bytes} [Tue Aug 2 11:01:50 2022] GET /compute/v2.1/os-snapshots/a795e9af-ce3b-4a91-92aa-6a7c5c5790b2 => generated 288 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 11:01:50.491618 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-4af5523d-2b66-411b-b5ff-da9ea874340a tempest-VolumesSnapshotsTestJSON-655782843 tempest-VolumesSnapshotsTestJSON-655782843-project] Calling method '.version_select at 0x7f7c4ec12160>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:50.575846 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-7352ad32-6965-4c91-9900-05a856b4207d tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:50.576527 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-7352ad32-6965-4c91-9900-05a856b4207d tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] [instance: 93775f02-e62c-4392-a1ed-cfd5dd956dd7] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:50.582750 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-7352ad32-6965-4c91-9900-05a856b4207d tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:50.583261 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-7352ad32-6965-4c91-9900-05a856b4207d tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:50.584013 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-7352ad32-6965-4c91-9900-05a856b4207d tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:50.584438 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-7352ad32-6965-4c91-9900-05a856b4207d tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:50.598938 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.wsgi [None req-7352ad32-6965-4c91-9900-05a856b4207d tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] HTTP exception thrown: Instance 93775f02-e62c-4392-a1ed-cfd5dd956dd7 could not be found. Aug 02 11:01:50.604582 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-7352ad32-6965-4c91-9900-05a856b4207d tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Request method failure captured: Aug 02 11:01:50.604582 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: request: GET /compute/v2.1/servers/93775f02-e62c-4392-a1ed-cfd5dd956dd7 HTTP/1.1 Aug 02 11:01:50.604582 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Accept: application/json Aug 02 11:01:50.604582 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Accept-Encoding: identity Aug 02 11:01:50.604582 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Connection: close Aug 02 11:01:50.604582 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Content-Length: 0 Aug 02 11:01:50.604582 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Content-Type: application/json Aug 02 11:01:50.604582 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Host: 10.222.0.115 Aug 02 11:01:50.604582 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Openstack-System-Scope: None Aug 02 11:01:50.604582 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: User-Agent: python-urllib3/1.26.10 Aug 02 11:01:50.604582 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Auth-Token: gAAAAABi6QKP2ZooXwKqX5KvPH3An3wyIoIsMgqpY1U6hmfsdfbyQPM8SwHstppNJS_IdskheOf_4r6IRhjVVcUg3tpKtkcShi4vzFBP96Mmoq9msduhL-i8w55s44Ke6IYK5jxLjLnFmn9xEdrciTrqBmIOO8O7BC5NmiD-a-j9BHWvNFOt1U0 Aug 02 11:01:50.604582 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Domain-Id: None Aug 02 11:01:50.604582 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Domain-Name: None Aug 02 11:01:50.604582 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Identity-Status: Confirmed Aug 02 11:01:50.604582 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Is-Admin-Project: True Aug 02 11:01:50.604582 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Project-Domain-Id: default Aug 02 11:01:50.604582 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Project-Domain-Name: Default Aug 02 11:01:50.604582 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Project-Id: 302e92110a1545f1b84644b8971bb6eb Aug 02 11:01:50.604582 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Project-Name: tempest-AttachVolumeTestJSON-322964104 Aug 02 11:01:50.604582 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Role: reader,member Aug 02 11:01:50.604582 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Roles: reader,member Aug 02 11:01:50.606836 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/302e92110a1545f1b84644b8971bb6eb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2/302e92110a1545f1b84644b8971bb6eb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/302e92110a1545f1b84644b8971bb6eb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.115:8080", "publicURL": "http://10.222.0.115:8080/v1/AUTH_302e92110a1545f1b84644b8971bb6eb"}]}] Aug 02 11:01:50.606836 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Tenant: tempest-AttachVolumeTestJSON-322964104 Aug 02 11:01:50.606836 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Tenant-Id: 302e92110a1545f1b84644b8971bb6eb Aug 02 11:01:50.606836 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Tenant-Name: tempest-AttachVolumeTestJSON-322964104 Aug 02 11:01:50.606836 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User: tempest-AttachVolumeTestJSON-322964104-project Aug 02 11:01:50.606836 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User-Domain-Id: default Aug 02 11:01:50.606836 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User-Domain-Name: Default Aug 02 11:01:50.606836 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User-Id: f3f41f17f5154e01a699043edc350cf8 Aug 02 11:01:50.606836 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User-Name: tempest-AttachVolumeTestJSON-322964104-project Aug 02 11:01:50.606836 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: method: > Aug 02 11:01:50.606836 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: exception: Instance 93775f02-e62c-4392-a1ed-cfd5dd956dd7 could not be found. Aug 02 11:01:50.606836 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: action_args: {'id': '93775f02-e62c-4392-a1ed-cfd5dd956dd7'} Aug 02 11:01:50.607615 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 11:01:50.607615 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:01:50.607615 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 11:01:50.607615 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 11:01:50.607615 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 11:01:50.607615 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 11:01:50.607615 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 11:01:50.607615 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 11:01:50.607615 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 11:01:50.607615 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 11:01:50.607615 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93775f02-e62c-4392-a1ed-cfd5dd956dd7 could not be found. Aug 02 11:01:50.607615 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 11:01:50.607615 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 11:01:50.607615 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 11:01:50.607615 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:01:50.607615 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 11:01:50.607615 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 11:01:50.607615 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 11:01:50.607615 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 11:01:50.607615 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 11:01:50.608940 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 11:01:50.608940 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 11:01:50.608940 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 11:01:50.608940 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 11:01:50.608940 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 11:01:50.608940 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 11:01:50.608940 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 11:01:50.608940 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93775f02-e62c-4392-a1ed-cfd5dd956dd7 could not be found. Aug 02 11:01:50.608940 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 11:01:50.608940 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 11:01:50.608940 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 11:01:50.608940 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:01:50.608940 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 11:01:50.608940 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 11:01:50.608940 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 11:01:50.608940 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 11:01:50.608940 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93775f02-e62c-4392-a1ed-cfd5dd956dd7 could not be found. Aug 02 11:01:50.608940 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 11:01:50.609986 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-7352ad32-6965-4c91-9900-05a856b4207d tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Returning 404 to user: Instance 93775f02-e62c-4392-a1ed-cfd5dd956dd7 could not be found. {{(pid=129953) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 11:01:50.609986 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-7352ad32-6965-4c91-9900-05a856b4207d tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] 10.222.0.115 "GET /compute/v2.1/servers/93775f02-e62c-4392-a1ed-cfd5dd956dd7" status: 404 len: 111 microversion: 2.1 time: 0.031048 Aug 02 11:01:50.609986 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 437/857] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:01:50 2022] GET /compute/v2.1/servers/93775f02-e62c-4392-a1ed-cfd5dd956dd7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 11:01:50.611299 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-37b352d3-45e3-4226-9180-39416ca73e17 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Calling method '.version_select at 0x7f7c576f4c10>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:50.630761 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-4af5523d-2b66-411b-b5ff-da9ea874340a tempest-VolumesSnapshotsTestJSON-655782843 tempest-VolumesSnapshotsTestJSON-655782843-project] 10.222.0.115 "DELETE /compute/v2.1/os-snapshots/a795e9af-ce3b-4a91-92aa-6a7c5c5790b2" status: 202 len: 0 microversion: 2.1 time: 0.142825 Aug 02 11:01:50.631356 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 421/858] 10.222.0.115 () {58 vars in 1259 bytes} [Tue Aug 2 11:01:50 2022] DELETE /compute/v2.1/os-snapshots/a795e9af-ce3b-4a91-92aa-6a7c5c5790b2 => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 11:01:50.640885 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-e28e8352-5ac6-4aab-bb36-80e01794b776 tempest-VolumesSnapshotsTestJSON-655782843 tempest-VolumesSnapshotsTestJSON-655782843-project] Calling method '.version_select at 0x7f7c4ec41160>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:50.671426 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-e28e8352-5ac6-4aab-bb36-80e01794b776 tempest-VolumesSnapshotsTestJSON-655782843 tempest-VolumesSnapshotsTestJSON-655782843-project] 10.222.0.115 "GET /compute/v2.1/os-snapshots/a795e9af-ce3b-4a91-92aa-6a7c5c5790b2" status: 200 len: 287 microversion: 2.1 time: 0.034851 Aug 02 11:01:50.672124 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 422/859] 10.222.0.115 () {58 vars in 1256 bytes} [Tue Aug 2 11:01:50 2022] GET /compute/v2.1/os-snapshots/a795e9af-ce3b-4a91-92aa-6a7c5c5790b2 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 11:01:50.711847 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-37b352d3-45e3-4226-9180-39416ca73e17 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] 10.222.0.115 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-682001819" status: 202 len: 0 microversion: 2.1 time: 0.103544 Aug 02 11:01:50.712546 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 438/860] 10.222.0.115 () {58 vars in 1223 bytes} [Tue Aug 2 11:01:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-682001819 => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 02 11:01:50.714747 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-8ad65501-4141-4282-bcf9-a58e9df95365 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:50.715415 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-8ad65501-4141-4282-bcf9-a58e9df95365 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: 07d63415-e151-4b2f-93ff-0769c401f16b] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:50.723253 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-8ad65501-4141-4282-bcf9-a58e9df95365 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:50.723819 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-8ad65501-4141-4282-bcf9-a58e9df95365 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:50.724492 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-8ad65501-4141-4282-bcf9-a58e9df95365 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:50.725539 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-8ad65501-4141-4282-bcf9-a58e9df95365 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:50.741827 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.wsgi [None req-8ad65501-4141-4282-bcf9-a58e9df95365 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] HTTP exception thrown: Instance 07d63415-e151-4b2f-93ff-0769c401f16b could not be found. Aug 02 11:01:50.743745 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-8ad65501-4141-4282-bcf9-a58e9df95365 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Request method failure captured: Aug 02 11:01:50.743745 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: request: GET /compute/v2.1/servers/07d63415-e151-4b2f-93ff-0769c401f16b HTTP/1.1 Aug 02 11:01:50.743745 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Accept: application/json Aug 02 11:01:50.743745 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Accept-Encoding: identity Aug 02 11:01:50.743745 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Connection: close Aug 02 11:01:50.743745 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Content-Length: 0 Aug 02 11:01:50.743745 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Content-Type: application/json Aug 02 11:01:50.743745 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Host: 10.222.0.115 Aug 02 11:01:50.743745 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Openstack-System-Scope: None Aug 02 11:01:50.743745 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: User-Agent: python-urllib3/1.26.10 Aug 02 11:01:50.743745 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Auth-Token: gAAAAABi6QKMm0zWjcrgGxsKGjmUpSACSDsl300OSZbmfbKI8W7YRiqQlsT7G2Yz8bTCtqeY5P5LouAzxFYTu1e6mP7SLmcSkT2w0SAqH9Ev0MtEiqJ7hFJOgCTtlSAmMKZk3KczE4deWY0afZWtzWq9Z6D1UUJ57x6ix6Lv8M0Q8lVdVaQlJYs Aug 02 11:01:50.743745 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Domain-Id: None Aug 02 11:01:50.743745 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Domain-Name: None Aug 02 11:01:50.743745 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Identity-Status: Confirmed Aug 02 11:01:50.743745 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Is-Admin-Project: True Aug 02 11:01:50.743745 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Project-Domain-Id: default Aug 02 11:01:50.743745 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Project-Domain-Name: Default Aug 02 11:01:50.743745 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Project-Id: 89a4a0cf1852449e8bfc59ddb5a902c1 Aug 02 11:01:50.743745 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Project-Name: tempest-AttachVolumeNegativeTest-1965368294 Aug 02 11:01:50.743745 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Role: reader,member Aug 02 11:01:50.743745 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Roles: reader,member Aug 02 11:01:50.745204 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/89a4a0cf1852449e8bfc59ddb5a902c1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2/89a4a0cf1852449e8bfc59ddb5a902c1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/89a4a0cf1852449e8bfc59ddb5a902c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.115:8080", "publicURL": "http://10.222.0.115:8080/v1/AUTH_89a4a0cf1852449e8bfc59ddb5a902c1"}]}] Aug 02 11:01:50.745204 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Tenant: tempest-AttachVolumeNegativeTest-1965368294 Aug 02 11:01:50.745204 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Tenant-Id: 89a4a0cf1852449e8bfc59ddb5a902c1 Aug 02 11:01:50.745204 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1965368294 Aug 02 11:01:50.745204 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User: tempest-AttachVolumeNegativeTest-1965368294-project Aug 02 11:01:50.745204 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User-Domain-Id: default Aug 02 11:01:50.745204 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User-Domain-Name: Default Aug 02 11:01:50.745204 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User-Id: 53bc14ada1564911b2f0a698aef3f333 Aug 02 11:01:50.745204 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User-Name: tempest-AttachVolumeNegativeTest-1965368294-project Aug 02 11:01:50.745204 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: method: > Aug 02 11:01:50.745204 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: exception: Instance 07d63415-e151-4b2f-93ff-0769c401f16b could not be found. Aug 02 11:01:50.745204 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: action_args: {'id': '07d63415-e151-4b2f-93ff-0769c401f16b'} Aug 02 11:01:50.746682 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 11:01:50.746682 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:01:50.746682 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 11:01:50.746682 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 11:01:50.746682 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 11:01:50.746682 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 11:01:50.746682 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 11:01:50.746682 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 11:01:50.746682 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 11:01:50.746682 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 11:01:50.746682 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07d63415-e151-4b2f-93ff-0769c401f16b could not be found. Aug 02 11:01:50.746682 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 11:01:50.746682 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 11:01:50.746682 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 11:01:50.746682 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:01:50.746682 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 11:01:50.746682 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 11:01:50.746682 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 11:01:50.746682 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 11:01:50.746682 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 11:01:50.748394 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 11:01:50.748394 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 11:01:50.748394 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 11:01:50.748394 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 11:01:50.748394 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 11:01:50.748394 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 11:01:50.748394 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 11:01:50.748394 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07d63415-e151-4b2f-93ff-0769c401f16b could not be found. Aug 02 11:01:50.748394 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 11:01:50.748394 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 11:01:50.748394 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 11:01:50.748394 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:01:50.748394 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 11:01:50.748394 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 11:01:50.748394 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 11:01:50.748394 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 11:01:50.748394 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07d63415-e151-4b2f-93ff-0769c401f16b could not be found. Aug 02 11:01:50.748394 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 11:01:50.749536 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-8ad65501-4141-4282-bcf9-a58e9df95365 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Returning 404 to user: Instance 07d63415-e151-4b2f-93ff-0769c401f16b could not be found. {{(pid=129952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 11:01:50.749536 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-8ad65501-4141-4282-bcf9-a58e9df95365 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "GET /compute/v2.1/servers/07d63415-e151-4b2f-93ff-0769c401f16b" status: 404 len: 111 microversion: 2.1 time: 0.035323 Aug 02 11:01:50.749536 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 423/861] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:01:50 2022] GET /compute/v2.1/servers/07d63415-e151-4b2f-93ff-0769c401f16b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 02 11:01:50.756575 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-9e9040b7-12e1-42d8-93fa-5c1107620de5 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Calling method '.version_select at 0x7f7c5769c0d0>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:50.843081 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-9e9040b7-12e1-42d8-93fa-5c1107620de5 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-205189833" status: 202 len: 0 microversion: 2.1 time: 0.091307 Aug 02 11:01:50.843678 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 439/862] 10.222.0.115 () {58 vars in 1223 bytes} [Tue Aug 2 11:01:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-205189833 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 11:01:51.689046 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-d9e94264-ce96-4b37-9500-1984eeae9654 tempest-VolumesSnapshotsTestJSON-655782843 tempest-VolumesSnapshotsTestJSON-655782843-project] Calling method '.version_select at 0x7f7c4ec411f0>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:51.742419 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.wsgi [None req-d9e94264-ce96-4b37-9500-1984eeae9654 tempest-VolumesSnapshotsTestJSON-655782843 tempest-VolumesSnapshotsTestJSON-655782843-project] HTTP exception thrown: Snapshot a795e9af-ce3b-4a91-92aa-6a7c5c5790b2 could not be found. Aug 02 11:01:51.744757 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-d9e94264-ce96-4b37-9500-1984eeae9654 tempest-VolumesSnapshotsTestJSON-655782843 tempest-VolumesSnapshotsTestJSON-655782843-project] Request method failure captured: Aug 02 11:01:51.744757 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: request: GET /compute/v2.1/os-snapshots/a795e9af-ce3b-4a91-92aa-6a7c5c5790b2 HTTP/1.1 Aug 02 11:01:51.744757 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Accept: application/json Aug 02 11:01:51.744757 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Accept-Encoding: identity Aug 02 11:01:51.744757 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Connection: close Aug 02 11:01:51.744757 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Content-Length: 0 Aug 02 11:01:51.744757 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Content-Type: application/json Aug 02 11:01:51.744757 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Host: 10.222.0.115 Aug 02 11:01:51.744757 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Openstack-System-Scope: None Aug 02 11:01:51.744757 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: User-Agent: python-urllib3/1.26.10 Aug 02 11:01:51.744757 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Auth-Token: gAAAAABi6QQX3wJTdPIMIa965Opva4MWkXJFhAzBf9dyw4yNfvTeKEKnsod3dVMtMz4oFrGofAT4sqkG4SUnlAhbx_KjMuuoElG1m_Banmdg43U4lUVrQw7QDNeXFJHYw8__eROlWpvDD_n69lBTcCNic9314TTRo2JhHZdbnPIf9MhRFqq3b3s Aug 02 11:01:51.744757 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Domain-Id: None Aug 02 11:01:51.744757 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Domain-Name: None Aug 02 11:01:51.744757 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Identity-Status: Confirmed Aug 02 11:01:51.744757 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Is-Admin-Project: True Aug 02 11:01:51.744757 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Project-Domain-Id: default Aug 02 11:01:51.744757 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Project-Domain-Name: Default Aug 02 11:01:51.744757 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Project-Id: f1ac57e1edbf4fd5b9c988aecc431363 Aug 02 11:01:51.744757 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-655782843 Aug 02 11:01:51.744757 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Role: reader,member Aug 02 11:01:51.744757 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Roles: reader,member Aug 02 11:01:51.746943 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/f1ac57e1edbf4fd5b9c988aecc431363"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2/f1ac57e1edbf4fd5b9c988aecc431363"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/f1ac57e1edbf4fd5b9c988aecc431363"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.115:8080", "publicURL": "http://10.222.0.115:8080/v1/AUTH_f1ac57e1edbf4fd5b9c988aecc431363"}]}] Aug 02 11:01:51.746943 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Tenant: tempest-VolumesSnapshotsTestJSON-655782843 Aug 02 11:01:51.746943 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Tenant-Id: f1ac57e1edbf4fd5b9c988aecc431363 Aug 02 11:01:51.746943 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-655782843 Aug 02 11:01:51.746943 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User: tempest-VolumesSnapshotsTestJSON-655782843-project Aug 02 11:01:51.746943 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User-Domain-Id: default Aug 02 11:01:51.746943 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User-Domain-Name: Default Aug 02 11:01:51.746943 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User-Id: 79fb99eabdfe47d498da216aacf6f23a Aug 02 11:01:51.746943 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User-Name: tempest-VolumesSnapshotsTestJSON-655782843-project Aug 02 11:01:51.746943 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: method: Aug 02 11:01:51.746943 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: exception: Snapshot a795e9af-ce3b-4a91-92aa-6a7c5c5790b2 could not be found. Aug 02 11:01:51.746943 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: action_args: {'id': 'a795e9af-ce3b-4a91-92aa-6a7c5c5790b2'} Aug 02 11:01:51.746943 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 11:01:51.749247 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:01:51.749247 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 02 11:01:51.749247 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 02 11:01:51.749247 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 02 11:01:51.749247 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 02 11:01:51.749247 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 02 11:01:51.749247 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 02 11:01:51.749247 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 02 11:01:51.749247 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 02 11:01:51.749247 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 02 11:01:51.749247 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 02 11:01:51.749247 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 11:01:51.749247 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 11:01:51.749247 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 11:01:51.749247 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 11:01:51.749247 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot a795e9af-ce3b-4a91-92aa-6a7c5c5790b2 could not be found. (HTTP 404) (Request-ID: req-8475e17a-6fe9-4869-b2f9-2f904cb8123d) Aug 02 11:01:51.749247 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 11:01:51.749247 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 11:01:51.752196 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 11:01:51.752196 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:01:51.752196 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 02 11:01:51.752196 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 02 11:01:51.752196 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 02 11:01:51.752196 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 02 11:01:51.752196 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 02 11:01:51.752196 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 02 11:01:51.752196 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 02 11:01:51.752196 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 02 11:01:51.752196 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 02 11:01:51.752196 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 02 11:01:51.752196 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 02 11:01:51.752196 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 02 11:01:51.752196 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 02 11:01:51.752196 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 02 11:01:51.752196 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 02 11:01:51.752196 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 02 11:01:51.752196 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 02 11:01:51.754965 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 02 11:01:51.754965 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 11:01:51.754965 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 11:01:51.754965 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 11:01:51.754965 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 11:01:51.754965 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot a795e9af-ce3b-4a91-92aa-6a7c5c5790b2 could not be found. Aug 02 11:01:51.754965 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 11:01:51.754965 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 11:01:51.754965 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 11:01:51.754965 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:01:51.754965 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 11:01:51.754965 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 11:01:51.754965 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 11:01:51.754965 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 11:01:51.754965 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 11:01:51.754965 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 11:01:51.754965 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 11:01:51.754965 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 11:01:51.754965 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 02 11:01:51.754965 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 11:01:51.756583 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot a795e9af-ce3b-4a91-92aa-6a7c5c5790b2 could not be found. Aug 02 11:01:51.756583 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 11:01:51.756583 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 11:01:51.756583 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 11:01:51.756583 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:01:51.756583 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 11:01:51.756583 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 11:01:51.756583 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 11:01:51.756583 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 11:01:51.756583 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot a795e9af-ce3b-4a91-92aa-6a7c5c5790b2 could not be found. Aug 02 11:01:51.756583 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 11:01:51.756583 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-d9e94264-ce96-4b37-9500-1984eeae9654 tempest-VolumesSnapshotsTestJSON-655782843 tempest-VolumesSnapshotsTestJSON-655782843-project] Returning 404 to user: Snapshot a795e9af-ce3b-4a91-92aa-6a7c5c5790b2 could not be found. {{(pid=129952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 11:01:51.756583 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-d9e94264-ce96-4b37-9500-1984eeae9654 tempest-VolumesSnapshotsTestJSON-655782843 tempest-VolumesSnapshotsTestJSON-655782843-project] 10.222.0.115 "GET /compute/v2.1/os-snapshots/a795e9af-ce3b-4a91-92aa-6a7c5c5790b2" status: 404 len: 111 microversion: 2.1 time: 0.066716 Aug 02 11:01:51.757549 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 424/863] 10.222.0.115 () {58 vars in 1256 bytes} [Tue Aug 2 11:01:51 2022] GET /compute/v2.1/os-snapshots/a795e9af-ce3b-4a91-92aa-6a7c5c5790b2 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 11:01:51.757647 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-5f8dbc66-869b-4052-a920-3cb6cbbb8bdf tempest-VolumesSnapshotsTestJSON-655782843 tempest-VolumesSnapshotsTestJSON-655782843-project] Calling method '.version_select at 0x7f7c541980d0>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:51.959040 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-5f8dbc66-869b-4052-a920-3cb6cbbb8bdf tempest-VolumesSnapshotsTestJSON-655782843 tempest-VolumesSnapshotsTestJSON-655782843-project] 10.222.0.115 "DELETE /compute/v2.1/os-volumes/5959c0d4-acd7-4659-9c0f-2a246d786911" status: 202 len: 0 microversion: 2.1 time: 0.207587 Aug 02 11:01:51.959723 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 440/864] 10.222.0.115 () {58 vars in 1253 bytes} [Tue Aug 2 11:01:51 2022] DELETE /compute/v2.1/os-volumes/5959c0d4-acd7-4659-9c0f-2a246d786911 => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 02 11:01:51.969600 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-813a9a20-0a2b-49f0-81af-4f2cb07ceacc tempest-VolumesSnapshotsTestJSON-655782843 tempest-VolumesSnapshotsTestJSON-655782843-project] Calling method '.version_select at 0x7f7c4ec99310>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:52.016178 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-813a9a20-0a2b-49f0-81af-4f2cb07ceacc tempest-VolumesSnapshotsTestJSON-655782843 tempest-VolumesSnapshotsTestJSON-655782843-project] 10.222.0.115 "GET /compute/v2.1/os-volumes/5959c0d4-acd7-4659-9c0f-2a246d786911" status: 200 len: 345 microversion: 2.1 time: 0.051820 Aug 02 11:01:52.016741 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 425/865] 10.222.0.115 () {58 vars in 1250 bytes} [Tue Aug 2 11:01:51 2022] GET /compute/v2.1/os-volumes/5959c0d4-acd7-4659-9c0f-2a246d786911 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 11:01:52.247113 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-13bf63c1-1758-4717-a94b-8b9b2ab874f5 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:52.249364 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-13bf63c1-1758-4717-a94b-8b9b2ab874f5 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: f86a8852-12b8-46d3-bd9b-bc140757b4c5] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:52.255603 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-13bf63c1-1758-4717-a94b-8b9b2ab874f5 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:52.256050 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-13bf63c1-1758-4717-a94b-8b9b2ab874f5 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:52.256981 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-13bf63c1-1758-4717-a94b-8b9b2ab874f5 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:52.257416 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-13bf63c1-1758-4717-a94b-8b9b2ab874f5 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:52.288771 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-13bf63c1-1758-4717-a94b-8b9b2ab874f5 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045713 Aug 02 11:01:52.289341 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 441/866] 10.222.0.115 () {60 vars in 1348 bytes} [Tue Aug 2 11:01:52 2022] GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:01:52.352431 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-04ae4ad8-af06-476d-a43e-4f2e5620450e tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:52.352927 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-04ae4ad8-af06-476d-a43e-4f2e5620450e tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: f86a8852-12b8-46d3-bd9b-bc140757b4c5] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:52.359621 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-04ae4ad8-af06-476d-a43e-4f2e5620450e tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:52.360095 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-04ae4ad8-af06-476d-a43e-4f2e5620450e tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:52.360839 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-04ae4ad8-af06-476d-a43e-4f2e5620450e tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:52.361276 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-04ae4ad8-af06-476d-a43e-4f2e5620450e tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:52.385577 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-04ae4ad8-af06-476d-a43e-4f2e5620450e tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: f86a8852-12b8-46d3-bd9b-bc140757b4c5] Going to try to terminate instance {{(pid=129952) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 11:01:52.509115 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG dbcounter [-] [129952] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=129952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 11:01:52.713877 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-04ae4ad8-af06-476d-a43e-4f2e5620450e tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "DELETE /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5" status: 204 len: 0 microversion: 2.20 time: 0.362682 Aug 02 11:01:52.713877 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 426/867] 10.222.0.115 () {60 vars in 1285 bytes} [Tue Aug 2 11:01:52 2022] DELETE /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 02 11:01:52.722142 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-2e4ef359-8b6d-44ac-9c64-0e1f2f832c33 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:52.722473 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-2e4ef359-8b6d-44ac-9c64-0e1f2f832c33 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: f86a8852-12b8-46d3-bd9b-bc140757b4c5] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:52.728610 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-2e4ef359-8b6d-44ac-9c64-0e1f2f832c33 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:52.729059 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-2e4ef359-8b6d-44ac-9c64-0e1f2f832c33 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:52.729824 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-2e4ef359-8b6d-44ac-9c64-0e1f2f832c33 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:52.730328 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-2e4ef359-8b6d-44ac-9c64-0e1f2f832c33 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:52.865580 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-2e4ef359-8b6d-44ac-9c64-0e1f2f832c33 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:01:52.874587 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-2e4ef359-8b6d-44ac-9c64-0e1f2f832c33 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:01:52.876186 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-2e4ef359-8b6d-44ac-9c64-0e1f2f832c33 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:01:52.877284 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-2e4ef359-8b6d-44ac-9c64-0e1f2f832c33 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5" status: 200 len: 1727 microversion: 2.20 time: 0.159580 Aug 02 11:01:52.877982 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 442/868] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 11:01:52 2022] GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5 => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 11:01:52.912371 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-60683d68-175e-435b-a0e3-6e5f508307a8 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:52.912945 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-60683d68-175e-435b-a0e3-6e5f508307a8 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: 07d63415-e151-4b2f-93ff-0769c401f16b] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:52.920333 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-60683d68-175e-435b-a0e3-6e5f508307a8 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:52.920776 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-60683d68-175e-435b-a0e3-6e5f508307a8 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:52.921533 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-60683d68-175e-435b-a0e3-6e5f508307a8 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:52.921979 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-60683d68-175e-435b-a0e3-6e5f508307a8 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:52.936480 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.wsgi [None req-60683d68-175e-435b-a0e3-6e5f508307a8 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] HTTP exception thrown: Instance 07d63415-e151-4b2f-93ff-0769c401f16b could not be found. Aug 02 11:01:52.939026 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-60683d68-175e-435b-a0e3-6e5f508307a8 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Request method failure captured: Aug 02 11:01:52.939026 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: request: DELETE /compute/v2.1/servers/07d63415-e151-4b2f-93ff-0769c401f16b HTTP/1.1 Aug 02 11:01:52.939026 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Accept: application/json Aug 02 11:01:52.939026 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Accept-Encoding: identity Aug 02 11:01:52.939026 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Connection: close Aug 02 11:01:52.939026 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Content-Length: 0 Aug 02 11:01:52.939026 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Content-Type: application/json Aug 02 11:01:52.939026 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Host: 10.222.0.115 Aug 02 11:01:52.939026 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Openstack-System-Scope: None Aug 02 11:01:52.939026 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: User-Agent: python-urllib3/1.26.10 Aug 02 11:01:52.939026 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Auth-Token: gAAAAABi6QKMm0zWjcrgGxsKGjmUpSACSDsl300OSZbmfbKI8W7YRiqQlsT7G2Yz8bTCtqeY5P5LouAzxFYTu1e6mP7SLmcSkT2w0SAqH9Ev0MtEiqJ7hFJOgCTtlSAmMKZk3KczE4deWY0afZWtzWq9Z6D1UUJ57x6ix6Lv8M0Q8lVdVaQlJYs Aug 02 11:01:52.939026 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Domain-Id: None Aug 02 11:01:52.939026 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Domain-Name: None Aug 02 11:01:52.939026 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Identity-Status: Confirmed Aug 02 11:01:52.939026 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Is-Admin-Project: True Aug 02 11:01:52.939026 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Project-Domain-Id: default Aug 02 11:01:52.939026 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Project-Domain-Name: Default Aug 02 11:01:52.939026 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Project-Id: 89a4a0cf1852449e8bfc59ddb5a902c1 Aug 02 11:01:52.939026 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Project-Name: tempest-AttachVolumeNegativeTest-1965368294 Aug 02 11:01:52.939026 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Role: reader,member Aug 02 11:01:52.939026 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Roles: reader,member Aug 02 11:01:52.940636 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/89a4a0cf1852449e8bfc59ddb5a902c1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2/89a4a0cf1852449e8bfc59ddb5a902c1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/89a4a0cf1852449e8bfc59ddb5a902c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.115:8080", "publicURL": "http://10.222.0.115:8080/v1/AUTH_89a4a0cf1852449e8bfc59ddb5a902c1"}]}] Aug 02 11:01:52.940636 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Tenant: tempest-AttachVolumeNegativeTest-1965368294 Aug 02 11:01:52.940636 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Tenant-Id: 89a4a0cf1852449e8bfc59ddb5a902c1 Aug 02 11:01:52.940636 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1965368294 Aug 02 11:01:52.940636 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User: tempest-AttachVolumeNegativeTest-1965368294-project Aug 02 11:01:52.940636 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User-Domain-Id: default Aug 02 11:01:52.940636 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User-Domain-Name: Default Aug 02 11:01:52.940636 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User-Id: 53bc14ada1564911b2f0a698aef3f333 Aug 02 11:01:52.940636 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User-Name: tempest-AttachVolumeNegativeTest-1965368294-project Aug 02 11:01:52.940636 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: method: > Aug 02 11:01:52.940636 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: exception: Instance 07d63415-e151-4b2f-93ff-0769c401f16b could not be found. Aug 02 11:01:52.940636 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: action_args: {'id': '07d63415-e151-4b2f-93ff-0769c401f16b'} Aug 02 11:01:52.942160 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 11:01:52.942160 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:01:52.942160 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 11:01:52.942160 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 11:01:52.942160 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 11:01:52.942160 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 11:01:52.942160 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 11:01:52.942160 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 11:01:52.942160 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 11:01:52.942160 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 11:01:52.942160 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07d63415-e151-4b2f-93ff-0769c401f16b could not be found. Aug 02 11:01:52.942160 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 11:01:52.942160 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 11:01:52.942160 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 11:01:52.942160 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:01:52.942160 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 11:01:52.942160 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 11:01:52.942160 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 11:01:52.942160 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 11:01:52.942160 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 11:01:52.943690 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 11:01:52.943690 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 11:01:52.943690 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 11:01:52.943690 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 11:01:52.943690 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 11:01:52.943690 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 11:01:52.943690 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 11:01:52.943690 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 11:01:52.943690 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 11:01:52.943690 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07d63415-e151-4b2f-93ff-0769c401f16b could not be found. Aug 02 11:01:52.943690 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 11:01:52.943690 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 11:01:52.943690 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 11:01:52.943690 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:01:52.943690 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 11:01:52.943690 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 11:01:52.943690 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 11:01:52.943690 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 11:01:52.943690 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07d63415-e151-4b2f-93ff-0769c401f16b could not be found. Aug 02 11:01:52.943690 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 11:01:52.945077 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-60683d68-175e-435b-a0e3-6e5f508307a8 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Returning 404 to user: Instance 07d63415-e151-4b2f-93ff-0769c401f16b could not be found. {{(pid=129952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 11:01:52.945077 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-60683d68-175e-435b-a0e3-6e5f508307a8 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "DELETE /compute/v2.1/servers/07d63415-e151-4b2f-93ff-0769c401f16b" status: 404 len: 111 microversion: 2.1 time: 0.032769 Aug 02 11:01:52.945077 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 427/869] 10.222.0.115 () {58 vars in 1244 bytes} [Tue Aug 2 11:01:52 2022] DELETE /compute/v2.1/servers/07d63415-e151-4b2f-93ff-0769c401f16b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 11:01:52.949228 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-4507d7d0-a6c4-4e46-97ed-4e660abebf4e tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:52.949884 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-4507d7d0-a6c4-4e46-97ed-4e660abebf4e tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: 07d63415-e151-4b2f-93ff-0769c401f16b] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:52.958902 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-4507d7d0-a6c4-4e46-97ed-4e660abebf4e tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:52.959376 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-4507d7d0-a6c4-4e46-97ed-4e660abebf4e tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:52.960149 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-4507d7d0-a6c4-4e46-97ed-4e660abebf4e tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:52.960565 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-4507d7d0-a6c4-4e46-97ed-4e660abebf4e tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:52.979590 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.wsgi [None req-4507d7d0-a6c4-4e46-97ed-4e660abebf4e tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] HTTP exception thrown: Instance 07d63415-e151-4b2f-93ff-0769c401f16b could not be found. Aug 02 11:01:52.981654 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-4507d7d0-a6c4-4e46-97ed-4e660abebf4e tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Request method failure captured: Aug 02 11:01:52.981654 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: request: GET /compute/v2.1/servers/07d63415-e151-4b2f-93ff-0769c401f16b HTTP/1.1 Aug 02 11:01:52.981654 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Accept: application/json Aug 02 11:01:52.981654 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Accept-Encoding: identity Aug 02 11:01:52.981654 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Connection: close Aug 02 11:01:52.981654 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Content-Length: 0 Aug 02 11:01:52.981654 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Content-Type: application/json Aug 02 11:01:52.981654 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Host: 10.222.0.115 Aug 02 11:01:52.981654 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Openstack-System-Scope: None Aug 02 11:01:52.981654 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: User-Agent: python-urllib3/1.26.10 Aug 02 11:01:52.981654 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Auth-Token: gAAAAABi6QKMm0zWjcrgGxsKGjmUpSACSDsl300OSZbmfbKI8W7YRiqQlsT7G2Yz8bTCtqeY5P5LouAzxFYTu1e6mP7SLmcSkT2w0SAqH9Ev0MtEiqJ7hFJOgCTtlSAmMKZk3KczE4deWY0afZWtzWq9Z6D1UUJ57x6ix6Lv8M0Q8lVdVaQlJYs Aug 02 11:01:52.981654 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Domain-Id: None Aug 02 11:01:52.981654 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Domain-Name: None Aug 02 11:01:52.981654 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Identity-Status: Confirmed Aug 02 11:01:52.981654 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Is-Admin-Project: True Aug 02 11:01:52.981654 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Project-Domain-Id: default Aug 02 11:01:52.981654 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Project-Domain-Name: Default Aug 02 11:01:52.981654 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Project-Id: 89a4a0cf1852449e8bfc59ddb5a902c1 Aug 02 11:01:52.981654 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Project-Name: tempest-AttachVolumeNegativeTest-1965368294 Aug 02 11:01:52.981654 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Role: reader,member Aug 02 11:01:52.981654 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Roles: reader,member Aug 02 11:01:52.983255 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/89a4a0cf1852449e8bfc59ddb5a902c1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2/89a4a0cf1852449e8bfc59ddb5a902c1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/89a4a0cf1852449e8bfc59ddb5a902c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.115:8080", "publicURL": "http://10.222.0.115:8080/v1/AUTH_89a4a0cf1852449e8bfc59ddb5a902c1"}]}] Aug 02 11:01:52.983255 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Tenant: tempest-AttachVolumeNegativeTest-1965368294 Aug 02 11:01:52.983255 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Tenant-Id: 89a4a0cf1852449e8bfc59ddb5a902c1 Aug 02 11:01:52.983255 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1965368294 Aug 02 11:01:52.983255 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User: tempest-AttachVolumeNegativeTest-1965368294-project Aug 02 11:01:52.983255 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User-Domain-Id: default Aug 02 11:01:52.983255 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User-Domain-Name: Default Aug 02 11:01:52.983255 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User-Id: 53bc14ada1564911b2f0a698aef3f333 Aug 02 11:01:52.983255 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User-Name: tempest-AttachVolumeNegativeTest-1965368294-project Aug 02 11:01:52.983255 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: method: > Aug 02 11:01:52.983255 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: exception: Instance 07d63415-e151-4b2f-93ff-0769c401f16b could not be found. Aug 02 11:01:52.983255 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: action_args: {'id': '07d63415-e151-4b2f-93ff-0769c401f16b'} Aug 02 11:01:52.984349 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 11:01:52.984349 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:01:52.984349 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 11:01:52.984349 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 11:01:52.984349 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 11:01:52.984349 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 11:01:52.984349 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 11:01:52.984349 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 11:01:52.984349 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 11:01:52.984349 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 11:01:52.984349 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07d63415-e151-4b2f-93ff-0769c401f16b could not be found. Aug 02 11:01:52.984349 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 11:01:52.984349 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 11:01:52.984349 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 11:01:52.984349 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:01:52.984349 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 11:01:52.984349 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 11:01:52.984349 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 11:01:52.984349 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 11:01:52.984349 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 11:01:52.987163 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 11:01:52.987163 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 11:01:52.987163 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 11:01:52.987163 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 11:01:52.987163 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 11:01:52.987163 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 11:01:52.987163 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 11:01:52.987163 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07d63415-e151-4b2f-93ff-0769c401f16b could not be found. Aug 02 11:01:52.987163 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 11:01:52.987163 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 11:01:52.987163 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 11:01:52.987163 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:01:52.987163 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 11:01:52.987163 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 11:01:52.987163 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 11:01:52.987163 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 11:01:52.987163 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07d63415-e151-4b2f-93ff-0769c401f16b could not be found. Aug 02 11:01:52.987163 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 11:01:52.988882 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-4507d7d0-a6c4-4e46-97ed-4e660abebf4e tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Returning 404 to user: Instance 07d63415-e151-4b2f-93ff-0769c401f16b could not be found. {{(pid=129953) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 11:01:52.988882 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-4507d7d0-a6c4-4e46-97ed-4e660abebf4e tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "GET /compute/v2.1/servers/07d63415-e151-4b2f-93ff-0769c401f16b" status: 404 len: 111 microversion: 2.1 time: 0.037745 Aug 02 11:01:52.988882 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 443/870] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:01:52 2022] GET /compute/v2.1/servers/07d63415-e151-4b2f-93ff-0769c401f16b => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 11:01:53.031339 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-3e85b7a0-e4e7-4fb4-ad9c-a64127c3d518 tempest-VolumesSnapshotsTestJSON-655782843 tempest-VolumesSnapshotsTestJSON-655782843-project] Calling method '.version_select at 0x7f7c4ec12a60>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:53.060917 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.wsgi [None req-3e85b7a0-e4e7-4fb4-ad9c-a64127c3d518 tempest-VolumesSnapshotsTestJSON-655782843 tempest-VolumesSnapshotsTestJSON-655782843-project] HTTP exception thrown: Volume 5959c0d4-acd7-4659-9c0f-2a246d786911 could not be found. Aug 02 11:01:53.062869 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-3e85b7a0-e4e7-4fb4-ad9c-a64127c3d518 tempest-VolumesSnapshotsTestJSON-655782843 tempest-VolumesSnapshotsTestJSON-655782843-project] Request method failure captured: Aug 02 11:01:53.062869 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: request: GET /compute/v2.1/os-volumes/5959c0d4-acd7-4659-9c0f-2a246d786911 HTTP/1.1 Aug 02 11:01:53.062869 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Accept: application/json Aug 02 11:01:53.062869 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Accept-Encoding: identity Aug 02 11:01:53.062869 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Connection: close Aug 02 11:01:53.062869 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Content-Length: 0 Aug 02 11:01:53.062869 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Content-Type: application/json Aug 02 11:01:53.062869 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Host: 10.222.0.115 Aug 02 11:01:53.062869 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Openstack-System-Scope: None Aug 02 11:01:53.062869 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: User-Agent: python-urllib3/1.26.10 Aug 02 11:01:53.062869 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Auth-Token: gAAAAABi6QQX3wJTdPIMIa965Opva4MWkXJFhAzBf9dyw4yNfvTeKEKnsod3dVMtMz4oFrGofAT4sqkG4SUnlAhbx_KjMuuoElG1m_Banmdg43U4lUVrQw7QDNeXFJHYw8__eROlWpvDD_n69lBTcCNic9314TTRo2JhHZdbnPIf9MhRFqq3b3s Aug 02 11:01:53.062869 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Domain-Id: None Aug 02 11:01:53.062869 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Domain-Name: None Aug 02 11:01:53.062869 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Identity-Status: Confirmed Aug 02 11:01:53.062869 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Is-Admin-Project: True Aug 02 11:01:53.062869 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Project-Domain-Id: default Aug 02 11:01:53.062869 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Project-Domain-Name: Default Aug 02 11:01:53.062869 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Project-Id: f1ac57e1edbf4fd5b9c988aecc431363 Aug 02 11:01:53.062869 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-655782843 Aug 02 11:01:53.062869 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Role: reader,member Aug 02 11:01:53.062869 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Roles: reader,member Aug 02 11:01:53.064517 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/f1ac57e1edbf4fd5b9c988aecc431363"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2/f1ac57e1edbf4fd5b9c988aecc431363"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/f1ac57e1edbf4fd5b9c988aecc431363"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.115:8080", "publicURL": "http://10.222.0.115:8080/v1/AUTH_f1ac57e1edbf4fd5b9c988aecc431363"}]}] Aug 02 11:01:53.064517 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Tenant: tempest-VolumesSnapshotsTestJSON-655782843 Aug 02 11:01:53.064517 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Tenant-Id: f1ac57e1edbf4fd5b9c988aecc431363 Aug 02 11:01:53.064517 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-655782843 Aug 02 11:01:53.064517 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User: tempest-VolumesSnapshotsTestJSON-655782843-project Aug 02 11:01:53.064517 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User-Domain-Id: default Aug 02 11:01:53.064517 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User-Domain-Name: Default Aug 02 11:01:53.064517 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User-Id: 79fb99eabdfe47d498da216aacf6f23a Aug 02 11:01:53.064517 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User-Name: tempest-VolumesSnapshotsTestJSON-655782843-project Aug 02 11:01:53.064517 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: method: Aug 02 11:01:53.064517 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: exception: Volume 5959c0d4-acd7-4659-9c0f-2a246d786911 could not be found. Aug 02 11:01:53.064517 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: action_args: {'id': '5959c0d4-acd7-4659-9c0f-2a246d786911'} Aug 02 11:01:53.064517 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 11:01:53.065499 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:01:53.065499 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 11:01:53.065499 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 11:01:53.065499 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 02 11:01:53.065499 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 02 11:01:53.065499 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 02 11:01:53.065499 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 02 11:01:53.065499 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 02 11:01:53.065499 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 02 11:01:53.065499 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 02 11:01:53.065499 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 02 11:01:53.065499 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 11:01:53.065499 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 11:01:53.065499 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 11:01:53.065499 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 11:01:53.065499 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5959c0d4-acd7-4659-9c0f-2a246d786911 could not be found. (HTTP 404) (Request-ID: req-ba94526f-9f93-4686-adb1-5f791c0ca8e4) Aug 02 11:01:53.065499 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 11:01:53.065499 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 11:01:53.065499 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 11:01:53.066922 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:01:53.066922 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 02 11:01:53.066922 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 02 11:01:53.066922 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 02 11:01:53.066922 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 02 11:01:53.066922 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 02 11:01:53.066922 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 02 11:01:53.066922 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 02 11:01:53.066922 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 02 11:01:53.066922 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 11:01:53.066922 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 11:01:53.066922 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 02 11:01:53.066922 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 02 11:01:53.066922 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 02 11:01:53.066922 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 02 11:01:53.066922 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 02 11:01:53.066922 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 02 11:01:53.066922 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 02 11:01:53.066922 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 02 11:01:53.068375 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 11:01:53.068375 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 11:01:53.068375 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 11:01:53.068375 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 11:01:53.068375 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5959c0d4-acd7-4659-9c0f-2a246d786911 could not be found. Aug 02 11:01:53.068375 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 11:01:53.068375 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 11:01:53.068375 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 11:01:53.068375 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:01:53.068375 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 11:01:53.068375 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 11:01:53.068375 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 11:01:53.068375 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 11:01:53.068375 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 11:01:53.068375 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 11:01:53.068375 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 11:01:53.068375 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 11:01:53.068375 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 02 11:01:53.068375 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 11:01:53.069790 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5959c0d4-acd7-4659-9c0f-2a246d786911 could not be found. Aug 02 11:01:53.069790 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 11:01:53.069790 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 11:01:53.069790 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 11:01:53.069790 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:01:53.069790 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 11:01:53.069790 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 11:01:53.069790 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 11:01:53.069790 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 11:01:53.069790 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5959c0d4-acd7-4659-9c0f-2a246d786911 could not be found. Aug 02 11:01:53.069790 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 11:01:53.069790 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-3e85b7a0-e4e7-4fb4-ad9c-a64127c3d518 tempest-VolumesSnapshotsTestJSON-655782843 tempest-VolumesSnapshotsTestJSON-655782843-project] Returning 404 to user: Volume 5959c0d4-acd7-4659-9c0f-2a246d786911 could not be found. {{(pid=129952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 11:01:53.069790 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-3e85b7a0-e4e7-4fb4-ad9c-a64127c3d518 tempest-VolumesSnapshotsTestJSON-655782843 tempest-VolumesSnapshotsTestJSON-655782843-project] 10.222.0.115 "GET /compute/v2.1/os-volumes/5959c0d4-acd7-4659-9c0f-2a246d786911" status: 404 len: 109 microversion: 2.1 time: 0.038156 Aug 02 11:01:53.069790 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 428/871] 10.222.0.115 () {58 vars in 1250 bytes} [Tue Aug 2 11:01:53 2022] GET /compute/v2.1/os-volumes/5959c0d4-acd7-4659-9c0f-2a246d786911 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 11:01:53.078785 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-0636369b-0823-4e71-ab2d-611076ea006c tempest-VolumesSnapshotsTestJSON-655782843 tempest-VolumesSnapshotsTestJSON-655782843-project] Calling method '.version_select at 0x7f7c576ea3a0>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:53.107220 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.wsgi [None req-0636369b-0823-4e71-ab2d-611076ea006c tempest-VolumesSnapshotsTestJSON-655782843 tempest-VolumesSnapshotsTestJSON-655782843-project] HTTP exception thrown: Volume 5959c0d4-acd7-4659-9c0f-2a246d786911 could not be found. Aug 02 11:01:53.109280 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-0636369b-0823-4e71-ab2d-611076ea006c tempest-VolumesSnapshotsTestJSON-655782843 tempest-VolumesSnapshotsTestJSON-655782843-project] Request method failure captured: Aug 02 11:01:53.109280 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: request: DELETE /compute/v2.1/os-volumes/5959c0d4-acd7-4659-9c0f-2a246d786911 HTTP/1.1 Aug 02 11:01:53.109280 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Accept: application/json Aug 02 11:01:53.109280 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Accept-Encoding: identity Aug 02 11:01:53.109280 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Connection: close Aug 02 11:01:53.109280 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Content-Length: 0 Aug 02 11:01:53.109280 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Content-Type: application/json Aug 02 11:01:53.109280 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Host: 10.222.0.115 Aug 02 11:01:53.109280 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Openstack-System-Scope: None Aug 02 11:01:53.109280 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: User-Agent: python-urllib3/1.26.10 Aug 02 11:01:53.109280 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Auth-Token: gAAAAABi6QQX3wJTdPIMIa965Opva4MWkXJFhAzBf9dyw4yNfvTeKEKnsod3dVMtMz4oFrGofAT4sqkG4SUnlAhbx_KjMuuoElG1m_Banmdg43U4lUVrQw7QDNeXFJHYw8__eROlWpvDD_n69lBTcCNic9314TTRo2JhHZdbnPIf9MhRFqq3b3s Aug 02 11:01:53.109280 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Domain-Id: None Aug 02 11:01:53.109280 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Domain-Name: None Aug 02 11:01:53.109280 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Identity-Status: Confirmed Aug 02 11:01:53.109280 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Is-Admin-Project: True Aug 02 11:01:53.109280 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Project-Domain-Id: default Aug 02 11:01:53.109280 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Project-Domain-Name: Default Aug 02 11:01:53.109280 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Project-Id: f1ac57e1edbf4fd5b9c988aecc431363 Aug 02 11:01:53.109280 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-655782843 Aug 02 11:01:53.109280 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Role: reader,member Aug 02 11:01:53.109280 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Roles: reader,member Aug 02 11:01:53.110930 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/f1ac57e1edbf4fd5b9c988aecc431363"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2/f1ac57e1edbf4fd5b9c988aecc431363"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/f1ac57e1edbf4fd5b9c988aecc431363"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.115:8080", "publicURL": "http://10.222.0.115:8080/v1/AUTH_f1ac57e1edbf4fd5b9c988aecc431363"}]}] Aug 02 11:01:53.110930 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Tenant: tempest-VolumesSnapshotsTestJSON-655782843 Aug 02 11:01:53.110930 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Tenant-Id: f1ac57e1edbf4fd5b9c988aecc431363 Aug 02 11:01:53.110930 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-655782843 Aug 02 11:01:53.110930 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User: tempest-VolumesSnapshotsTestJSON-655782843-project Aug 02 11:01:53.110930 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User-Domain-Id: default Aug 02 11:01:53.110930 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User-Domain-Name: Default Aug 02 11:01:53.110930 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User-Id: 79fb99eabdfe47d498da216aacf6f23a Aug 02 11:01:53.110930 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User-Name: tempest-VolumesSnapshotsTestJSON-655782843-project Aug 02 11:01:53.110930 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: method: Aug 02 11:01:53.110930 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: exception: Volume 5959c0d4-acd7-4659-9c0f-2a246d786911 could not be found. Aug 02 11:01:53.110930 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: action_args: {'id': '5959c0d4-acd7-4659-9c0f-2a246d786911'} Aug 02 11:01:53.110930 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 11:01:53.111997 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:01:53.111997 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 11:01:53.111997 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 11:01:53.111997 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 02 11:01:53.111997 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 02 11:01:53.111997 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 02 11:01:53.111997 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 02 11:01:53.111997 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 02 11:01:53.111997 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 02 11:01:53.111997 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 02 11:01:53.111997 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 02 11:01:53.111997 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 11:01:53.111997 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 11:01:53.111997 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 11:01:53.111997 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 11:01:53.111997 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5959c0d4-acd7-4659-9c0f-2a246d786911 could not be found. (HTTP 404) (Request-ID: req-fb45a77e-d48e-4cad-841c-c0bfceb94f1d) Aug 02 11:01:53.111997 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 11:01:53.111997 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 11:01:53.111997 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 11:01:53.113358 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:01:53.113358 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 02 11:01:53.113358 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 02 11:01:53.113358 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 02 11:01:53.113358 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 02 11:01:53.113358 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 02 11:01:53.113358 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 02 11:01:53.113358 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 02 11:01:53.113358 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 02 11:01:53.113358 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 11:01:53.113358 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 11:01:53.113358 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 02 11:01:53.113358 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 02 11:01:53.113358 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 02 11:01:53.113358 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 02 11:01:53.113358 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 02 11:01:53.113358 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 02 11:01:53.113358 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 02 11:01:53.113358 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 02 11:01:53.114582 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 11:01:53.114582 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 11:01:53.114582 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 11:01:53.114582 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 11:01:53.114582 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5959c0d4-acd7-4659-9c0f-2a246d786911 could not be found. Aug 02 11:01:53.114582 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 11:01:53.114582 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 11:01:53.114582 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 11:01:53.114582 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:01:53.114582 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 11:01:53.114582 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 11:01:53.114582 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 11:01:53.114582 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 11:01:53.114582 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 11:01:53.114582 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 11:01:53.114582 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 11:01:53.114582 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 11:01:53.114582 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 02 11:01:53.114582 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 11:01:53.115951 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5959c0d4-acd7-4659-9c0f-2a246d786911 could not be found. Aug 02 11:01:53.115951 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 11:01:53.115951 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 11:01:53.115951 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 11:01:53.115951 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:01:53.115951 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 11:01:53.115951 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 11:01:53.115951 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 11:01:53.115951 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 11:01:53.115951 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5959c0d4-acd7-4659-9c0f-2a246d786911 could not be found. Aug 02 11:01:53.115951 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 11:01:53.115951 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-0636369b-0823-4e71-ab2d-611076ea006c tempest-VolumesSnapshotsTestJSON-655782843 tempest-VolumesSnapshotsTestJSON-655782843-project] Returning 404 to user: Volume 5959c0d4-acd7-4659-9c0f-2a246d786911 could not be found. {{(pid=129953) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 11:01:53.115951 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-0636369b-0823-4e71-ab2d-611076ea006c tempest-VolumesSnapshotsTestJSON-655782843 tempest-VolumesSnapshotsTestJSON-655782843-project] 10.222.0.115 "DELETE /compute/v2.1/os-volumes/5959c0d4-acd7-4659-9c0f-2a246d786911" status: 404 len: 109 microversion: 2.1 time: 0.035866 Aug 02 11:01:53.115951 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 444/872] 10.222.0.115 () {58 vars in 1253 bytes} [Tue Aug 2 11:01:53 2022] DELETE /compute/v2.1/os-volumes/5959c0d4-acd7-4659-9c0f-2a246d786911 => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 11:01:53.122248 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-414350ed-1f2d-44e8-8164-60e6f7273680 tempest-VolumesSnapshotsTestJSON-655782843 tempest-VolumesSnapshotsTestJSON-655782843-project] Calling method '.version_select at 0x7f7c4ec99af0>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:53.150706 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.wsgi [None req-414350ed-1f2d-44e8-8164-60e6f7273680 tempest-VolumesSnapshotsTestJSON-655782843 tempest-VolumesSnapshotsTestJSON-655782843-project] HTTP exception thrown: Volume 5959c0d4-acd7-4659-9c0f-2a246d786911 could not be found. Aug 02 11:01:53.153111 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-414350ed-1f2d-44e8-8164-60e6f7273680 tempest-VolumesSnapshotsTestJSON-655782843 tempest-VolumesSnapshotsTestJSON-655782843-project] Request method failure captured: Aug 02 11:01:53.153111 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: request: GET /compute/v2.1/os-volumes/5959c0d4-acd7-4659-9c0f-2a246d786911 HTTP/1.1 Aug 02 11:01:53.153111 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Accept: application/json Aug 02 11:01:53.153111 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Accept-Encoding: identity Aug 02 11:01:53.153111 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Connection: close Aug 02 11:01:53.153111 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Content-Length: 0 Aug 02 11:01:53.153111 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Content-Type: application/json Aug 02 11:01:53.153111 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Host: 10.222.0.115 Aug 02 11:01:53.153111 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Openstack-System-Scope: None Aug 02 11:01:53.153111 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: User-Agent: python-urllib3/1.26.10 Aug 02 11:01:53.153111 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Auth-Token: gAAAAABi6QQX3wJTdPIMIa965Opva4MWkXJFhAzBf9dyw4yNfvTeKEKnsod3dVMtMz4oFrGofAT4sqkG4SUnlAhbx_KjMuuoElG1m_Banmdg43U4lUVrQw7QDNeXFJHYw8__eROlWpvDD_n69lBTcCNic9314TTRo2JhHZdbnPIf9MhRFqq3b3s Aug 02 11:01:53.153111 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Domain-Id: None Aug 02 11:01:53.153111 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Domain-Name: None Aug 02 11:01:53.153111 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Identity-Status: Confirmed Aug 02 11:01:53.153111 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Is-Admin-Project: True Aug 02 11:01:53.153111 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Project-Domain-Id: default Aug 02 11:01:53.153111 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Project-Domain-Name: Default Aug 02 11:01:53.153111 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Project-Id: f1ac57e1edbf4fd5b9c988aecc431363 Aug 02 11:01:53.153111 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-655782843 Aug 02 11:01:53.153111 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Role: reader,member Aug 02 11:01:53.153111 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Roles: reader,member Aug 02 11:01:53.154732 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/f1ac57e1edbf4fd5b9c988aecc431363"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2/f1ac57e1edbf4fd5b9c988aecc431363"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/f1ac57e1edbf4fd5b9c988aecc431363"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.115:8080", "publicURL": "http://10.222.0.115:8080/v1/AUTH_f1ac57e1edbf4fd5b9c988aecc431363"}]}] Aug 02 11:01:53.154732 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Tenant: tempest-VolumesSnapshotsTestJSON-655782843 Aug 02 11:01:53.154732 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Tenant-Id: f1ac57e1edbf4fd5b9c988aecc431363 Aug 02 11:01:53.154732 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-655782843 Aug 02 11:01:53.154732 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User: tempest-VolumesSnapshotsTestJSON-655782843-project Aug 02 11:01:53.154732 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User-Domain-Id: default Aug 02 11:01:53.154732 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User-Domain-Name: Default Aug 02 11:01:53.154732 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User-Id: 79fb99eabdfe47d498da216aacf6f23a Aug 02 11:01:53.154732 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User-Name: tempest-VolumesSnapshotsTestJSON-655782843-project Aug 02 11:01:53.154732 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: method: Aug 02 11:01:53.154732 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: exception: Volume 5959c0d4-acd7-4659-9c0f-2a246d786911 could not be found. Aug 02 11:01:53.154732 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: action_args: {'id': '5959c0d4-acd7-4659-9c0f-2a246d786911'} Aug 02 11:01:53.154732 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 11:01:53.155803 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:01:53.155803 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 11:01:53.155803 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 11:01:53.155803 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 02 11:01:53.155803 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 02 11:01:53.155803 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 02 11:01:53.155803 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 02 11:01:53.155803 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 02 11:01:53.155803 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 02 11:01:53.155803 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 02 11:01:53.155803 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 02 11:01:53.155803 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 11:01:53.155803 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 11:01:53.155803 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 11:01:53.155803 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 11:01:53.155803 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5959c0d4-acd7-4659-9c0f-2a246d786911 could not be found. (HTTP 404) (Request-ID: req-6400e415-fc4e-4042-8e9a-f023c63b52d7) Aug 02 11:01:53.155803 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 11:01:53.155803 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 11:01:53.155803 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 11:01:53.157281 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:01:53.157281 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 02 11:01:53.157281 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 02 11:01:53.157281 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 02 11:01:53.157281 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 02 11:01:53.157281 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 02 11:01:53.157281 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 02 11:01:53.157281 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 02 11:01:53.157281 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 02 11:01:53.157281 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 11:01:53.157281 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 11:01:53.157281 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 02 11:01:53.157281 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 02 11:01:53.157281 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 02 11:01:53.157281 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 02 11:01:53.157281 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 02 11:01:53.157281 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 02 11:01:53.157281 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 02 11:01:53.157281 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 02 11:01:53.158719 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 11:01:53.158719 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 11:01:53.158719 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 11:01:53.158719 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 11:01:53.158719 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5959c0d4-acd7-4659-9c0f-2a246d786911 could not be found. Aug 02 11:01:53.158719 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 11:01:53.158719 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 11:01:53.158719 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 11:01:53.158719 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:01:53.158719 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 11:01:53.158719 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 11:01:53.158719 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 11:01:53.158719 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 11:01:53.158719 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 11:01:53.158719 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 11:01:53.158719 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 11:01:53.158719 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 11:01:53.158719 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 02 11:01:53.158719 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 11:01:53.160177 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5959c0d4-acd7-4659-9c0f-2a246d786911 could not be found. Aug 02 11:01:53.160177 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 11:01:53.160177 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 11:01:53.160177 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 11:01:53.160177 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:01:53.160177 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 11:01:53.160177 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 11:01:53.160177 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 11:01:53.160177 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 11:01:53.160177 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5959c0d4-acd7-4659-9c0f-2a246d786911 could not be found. Aug 02 11:01:53.160177 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 11:01:53.160177 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-414350ed-1f2d-44e8-8164-60e6f7273680 tempest-VolumesSnapshotsTestJSON-655782843 tempest-VolumesSnapshotsTestJSON-655782843-project] Returning 404 to user: Volume 5959c0d4-acd7-4659-9c0f-2a246d786911 could not be found. {{(pid=129952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 11:01:53.160177 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-414350ed-1f2d-44e8-8164-60e6f7273680 tempest-VolumesSnapshotsTestJSON-655782843 tempest-VolumesSnapshotsTestJSON-655782843-project] 10.222.0.115 "GET /compute/v2.1/os-volumes/5959c0d4-acd7-4659-9c0f-2a246d786911" status: 404 len: 109 microversion: 2.1 time: 0.037232 Aug 02 11:01:53.160177 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 429/873] 10.222.0.115 () {58 vars in 1250 bytes} [Tue Aug 2 11:01:53 2022] GET /compute/v2.1/os-volumes/5959c0d4-acd7-4659-9c0f-2a246d786911 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 11:01:53.902495 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-fe666d18-cb39-40f7-879b-9b4ef286b325 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:53.903584 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-fe666d18-cb39-40f7-879b-9b4ef286b325 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: f86a8852-12b8-46d3-bd9b-bc140757b4c5] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:53.910637 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-fe666d18-cb39-40f7-879b-9b4ef286b325 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:53.911106 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-fe666d18-cb39-40f7-879b-9b4ef286b325 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:53.911879 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-fe666d18-cb39-40f7-879b-9b4ef286b325 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:53.912312 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-fe666d18-cb39-40f7-879b-9b4ef286b325 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:53.934273 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG dbcounter [-] [129953] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 11:01:54.048562 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-5d03a4f1-1864-4c16-9c61-18397c881ba6 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:54.049700 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-5d03a4f1-1864-4c16-9c61-18397c881ba6 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] [instance: 93775f02-e62c-4392-a1ed-cfd5dd956dd7] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:54.056689 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-5d03a4f1-1864-4c16-9c61-18397c881ba6 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:54.057555 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-5d03a4f1-1864-4c16-9c61-18397c881ba6 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:54.058597 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-5d03a4f1-1864-4c16-9c61-18397c881ba6 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:54.059409 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-5d03a4f1-1864-4c16-9c61-18397c881ba6 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:54.069540 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-fe666d18-cb39-40f7-879b-9b4ef286b325 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:01:54.074659 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.wsgi [None req-5d03a4f1-1864-4c16-9c61-18397c881ba6 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] HTTP exception thrown: Instance 93775f02-e62c-4392-a1ed-cfd5dd956dd7 could not be found. Aug 02 11:01:54.076383 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-5d03a4f1-1864-4c16-9c61-18397c881ba6 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Request method failure captured: Aug 02 11:01:54.076383 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: request: DELETE /compute/v2.1/servers/93775f02-e62c-4392-a1ed-cfd5dd956dd7 HTTP/1.1 Aug 02 11:01:54.076383 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Accept: application/json Aug 02 11:01:54.076383 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Accept-Encoding: identity Aug 02 11:01:54.076383 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Connection: close Aug 02 11:01:54.076383 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Content-Length: 0 Aug 02 11:01:54.076383 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Content-Type: application/json Aug 02 11:01:54.076383 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Host: 10.222.0.115 Aug 02 11:01:54.076383 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Openstack-System-Scope: None Aug 02 11:01:54.076383 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: User-Agent: python-urllib3/1.26.10 Aug 02 11:01:54.076383 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Auth-Token: gAAAAABi6QKP2ZooXwKqX5KvPH3An3wyIoIsMgqpY1U6hmfsdfbyQPM8SwHstppNJS_IdskheOf_4r6IRhjVVcUg3tpKtkcShi4vzFBP96Mmoq9msduhL-i8w55s44Ke6IYK5jxLjLnFmn9xEdrciTrqBmIOO8O7BC5NmiD-a-j9BHWvNFOt1U0 Aug 02 11:01:54.076383 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Domain-Id: None Aug 02 11:01:54.076383 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Domain-Name: None Aug 02 11:01:54.076383 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Identity-Status: Confirmed Aug 02 11:01:54.076383 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Is-Admin-Project: True Aug 02 11:01:54.076383 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Project-Domain-Id: default Aug 02 11:01:54.076383 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Project-Domain-Name: Default Aug 02 11:01:54.076383 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Project-Id: 302e92110a1545f1b84644b8971bb6eb Aug 02 11:01:54.076383 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Project-Name: tempest-AttachVolumeTestJSON-322964104 Aug 02 11:01:54.076383 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Role: reader,member Aug 02 11:01:54.076383 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Roles: reader,member Aug 02 11:01:54.077825 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/302e92110a1545f1b84644b8971bb6eb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2/302e92110a1545f1b84644b8971bb6eb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/302e92110a1545f1b84644b8971bb6eb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.115:8080", "publicURL": "http://10.222.0.115:8080/v1/AUTH_302e92110a1545f1b84644b8971bb6eb"}]}] Aug 02 11:01:54.077825 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Tenant: tempest-AttachVolumeTestJSON-322964104 Aug 02 11:01:54.077825 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Tenant-Id: 302e92110a1545f1b84644b8971bb6eb Aug 02 11:01:54.077825 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Tenant-Name: tempest-AttachVolumeTestJSON-322964104 Aug 02 11:01:54.077825 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User: tempest-AttachVolumeTestJSON-322964104-project Aug 02 11:01:54.077825 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User-Domain-Id: default Aug 02 11:01:54.077825 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User-Domain-Name: Default Aug 02 11:01:54.077825 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User-Id: f3f41f17f5154e01a699043edc350cf8 Aug 02 11:01:54.077825 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User-Name: tempest-AttachVolumeTestJSON-322964104-project Aug 02 11:01:54.077825 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: method: > Aug 02 11:01:54.077825 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: exception: Instance 93775f02-e62c-4392-a1ed-cfd5dd956dd7 could not be found. Aug 02 11:01:54.077825 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: action_args: {'id': '93775f02-e62c-4392-a1ed-cfd5dd956dd7'} Aug 02 11:01:54.078564 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 11:01:54.078564 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:01:54.078564 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 11:01:54.078564 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 11:01:54.078564 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 11:01:54.078564 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 11:01:54.078564 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 11:01:54.078564 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 11:01:54.078564 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 11:01:54.078564 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 11:01:54.078564 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93775f02-e62c-4392-a1ed-cfd5dd956dd7 could not be found. Aug 02 11:01:54.078564 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 11:01:54.078564 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 11:01:54.078564 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 11:01:54.078564 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:01:54.078564 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 11:01:54.078564 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 11:01:54.078564 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 11:01:54.078564 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 11:01:54.078564 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 11:01:54.079795 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 11:01:54.079795 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 11:01:54.079795 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 11:01:54.079795 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 11:01:54.079795 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 11:01:54.079795 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 11:01:54.079795 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 11:01:54.079795 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 11:01:54.079795 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 11:01:54.079795 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93775f02-e62c-4392-a1ed-cfd5dd956dd7 could not be found. Aug 02 11:01:54.079795 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 11:01:54.079795 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 11:01:54.079795 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 11:01:54.079795 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:01:54.079795 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 11:01:54.079795 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 11:01:54.079795 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 11:01:54.079795 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 11:01:54.079795 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93775f02-e62c-4392-a1ed-cfd5dd956dd7 could not be found. Aug 02 11:01:54.079795 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 11:01:54.080999 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-fe666d18-cb39-40f7-879b-9b4ef286b325 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:01:54.080999 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-fe666d18-cb39-40f7-879b-9b4ef286b325 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:01:54.080999 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-fe666d18-cb39-40f7-879b-9b4ef286b325 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5" status: 200 len: 1727 microversion: 2.20 time: 0.183312 Aug 02 11:01:54.081679 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 445/874] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 11:01:53 2022] GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5 => generated 1727 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 11:01:54.082599 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-5d03a4f1-1864-4c16-9c61-18397c881ba6 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Returning 404 to user: Instance 93775f02-e62c-4392-a1ed-cfd5dd956dd7 could not be found. {{(pid=129952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 11:01:54.083472 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-5d03a4f1-1864-4c16-9c61-18397c881ba6 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] 10.222.0.115 "DELETE /compute/v2.1/servers/93775f02-e62c-4392-a1ed-cfd5dd956dd7" status: 404 len: 111 microversion: 2.1 time: 0.039545 Aug 02 11:01:54.084014 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 430/875] 10.222.0.115 () {58 vars in 1244 bytes} [Tue Aug 2 11:01:54 2022] DELETE /compute/v2.1/servers/93775f02-e62c-4392-a1ed-cfd5dd956dd7 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 11:01:54.093122 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-dd9d0a80-5f35-47f9-87de-131987f5676b tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:54.093963 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-dd9d0a80-5f35-47f9-87de-131987f5676b tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] [instance: 93775f02-e62c-4392-a1ed-cfd5dd956dd7] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:54.100104 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-dd9d0a80-5f35-47f9-87de-131987f5676b tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:54.100563 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-dd9d0a80-5f35-47f9-87de-131987f5676b tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:54.101303 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-dd9d0a80-5f35-47f9-87de-131987f5676b tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:54.101779 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-dd9d0a80-5f35-47f9-87de-131987f5676b tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:54.115616 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.wsgi [None req-dd9d0a80-5f35-47f9-87de-131987f5676b tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] HTTP exception thrown: Instance 93775f02-e62c-4392-a1ed-cfd5dd956dd7 could not be found. Aug 02 11:01:54.117121 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-dd9d0a80-5f35-47f9-87de-131987f5676b tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Request method failure captured: Aug 02 11:01:54.117121 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: request: GET /compute/v2.1/servers/93775f02-e62c-4392-a1ed-cfd5dd956dd7 HTTP/1.1 Aug 02 11:01:54.117121 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Accept: application/json Aug 02 11:01:54.117121 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Accept-Encoding: identity Aug 02 11:01:54.117121 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Connection: close Aug 02 11:01:54.117121 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Content-Length: 0 Aug 02 11:01:54.117121 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Content-Type: application/json Aug 02 11:01:54.117121 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Host: 10.222.0.115 Aug 02 11:01:54.117121 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Openstack-System-Scope: None Aug 02 11:01:54.117121 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: User-Agent: python-urllib3/1.26.10 Aug 02 11:01:54.117121 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Auth-Token: gAAAAABi6QKP2ZooXwKqX5KvPH3An3wyIoIsMgqpY1U6hmfsdfbyQPM8SwHstppNJS_IdskheOf_4r6IRhjVVcUg3tpKtkcShi4vzFBP96Mmoq9msduhL-i8w55s44Ke6IYK5jxLjLnFmn9xEdrciTrqBmIOO8O7BC5NmiD-a-j9BHWvNFOt1U0 Aug 02 11:01:54.117121 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Domain-Id: None Aug 02 11:01:54.117121 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Domain-Name: None Aug 02 11:01:54.117121 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Identity-Status: Confirmed Aug 02 11:01:54.117121 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Is-Admin-Project: True Aug 02 11:01:54.117121 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Project-Domain-Id: default Aug 02 11:01:54.117121 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Project-Domain-Name: Default Aug 02 11:01:54.117121 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Project-Id: 302e92110a1545f1b84644b8971bb6eb Aug 02 11:01:54.117121 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Project-Name: tempest-AttachVolumeTestJSON-322964104 Aug 02 11:01:54.117121 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Role: reader,member Aug 02 11:01:54.117121 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Roles: reader,member Aug 02 11:01:54.118738 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/302e92110a1545f1b84644b8971bb6eb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2/302e92110a1545f1b84644b8971bb6eb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/302e92110a1545f1b84644b8971bb6eb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.115:8080", "publicURL": "http://10.222.0.115:8080/v1/AUTH_302e92110a1545f1b84644b8971bb6eb"}]}] Aug 02 11:01:54.118738 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Tenant: tempest-AttachVolumeTestJSON-322964104 Aug 02 11:01:54.118738 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Tenant-Id: 302e92110a1545f1b84644b8971bb6eb Aug 02 11:01:54.118738 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Tenant-Name: tempest-AttachVolumeTestJSON-322964104 Aug 02 11:01:54.118738 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User: tempest-AttachVolumeTestJSON-322964104-project Aug 02 11:01:54.118738 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User-Domain-Id: default Aug 02 11:01:54.118738 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User-Domain-Name: Default Aug 02 11:01:54.118738 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User-Id: f3f41f17f5154e01a699043edc350cf8 Aug 02 11:01:54.118738 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User-Name: tempest-AttachVolumeTestJSON-322964104-project Aug 02 11:01:54.118738 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: method: > Aug 02 11:01:54.118738 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: exception: Instance 93775f02-e62c-4392-a1ed-cfd5dd956dd7 could not be found. Aug 02 11:01:54.118738 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: action_args: {'id': '93775f02-e62c-4392-a1ed-cfd5dd956dd7'} Aug 02 11:01:54.120002 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 11:01:54.120002 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:01:54.120002 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 11:01:54.120002 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 11:01:54.120002 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 11:01:54.120002 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 11:01:54.120002 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 11:01:54.120002 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 11:01:54.120002 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 11:01:54.120002 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 11:01:54.120002 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93775f02-e62c-4392-a1ed-cfd5dd956dd7 could not be found. Aug 02 11:01:54.120002 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 11:01:54.120002 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 11:01:54.120002 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 11:01:54.120002 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:01:54.120002 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 11:01:54.120002 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 11:01:54.120002 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 11:01:54.120002 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 11:01:54.120002 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 11:01:54.121710 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 11:01:54.121710 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 11:01:54.121710 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 11:01:54.121710 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 11:01:54.121710 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 11:01:54.121710 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 11:01:54.121710 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 11:01:54.121710 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93775f02-e62c-4392-a1ed-cfd5dd956dd7 could not be found. Aug 02 11:01:54.121710 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 11:01:54.121710 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 11:01:54.121710 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 11:01:54.121710 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:01:54.121710 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 11:01:54.121710 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 11:01:54.121710 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 11:01:54.121710 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 11:01:54.121710 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93775f02-e62c-4392-a1ed-cfd5dd956dd7 could not be found. Aug 02 11:01:54.121710 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 11:01:54.123218 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-dd9d0a80-5f35-47f9-87de-131987f5676b tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Returning 404 to user: Instance 93775f02-e62c-4392-a1ed-cfd5dd956dd7 could not be found. {{(pid=129953) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 11:01:54.123218 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-dd9d0a80-5f35-47f9-87de-131987f5676b tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] 10.222.0.115 "GET /compute/v2.1/servers/93775f02-e62c-4392-a1ed-cfd5dd956dd7" status: 404 len: 111 microversion: 2.1 time: 0.030198 Aug 02 11:01:54.123218 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 446/876] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:01:54 2022] GET /compute/v2.1/servers/93775f02-e62c-4392-a1ed-cfd5dd956dd7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 11:01:54.277896 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-7749af36-07a6-4f33-9060-85fc7085c734 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:54.278666 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-7749af36-07a6-4f33-9060-85fc7085c734 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: a780ca09-3975-44eb-9464-355460c10686] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:54.284689 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-7749af36-07a6-4f33-9060-85fc7085c734 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:54.285134 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-7749af36-07a6-4f33-9060-85fc7085c734 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:54.285885 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-7749af36-07a6-4f33-9060-85fc7085c734 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:54.286316 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-7749af36-07a6-4f33-9060-85fc7085c734 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:54.300582 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.wsgi [None req-7749af36-07a6-4f33-9060-85fc7085c734 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] HTTP exception thrown: Instance a780ca09-3975-44eb-9464-355460c10686 could not be found. Aug 02 11:01:54.302125 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-7749af36-07a6-4f33-9060-85fc7085c734 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Request method failure captured: Aug 02 11:01:54.302125 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: request: DELETE /compute/v2.1/servers/a780ca09-3975-44eb-9464-355460c10686 HTTP/1.1 Aug 02 11:01:54.302125 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Accept: application/json Aug 02 11:01:54.302125 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Accept-Encoding: identity Aug 02 11:01:54.302125 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Connection: close Aug 02 11:01:54.302125 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Content-Length: 0 Aug 02 11:01:54.302125 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Content-Type: application/json Aug 02 11:01:54.302125 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Host: 10.222.0.115 Aug 02 11:01:54.302125 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Openstack-System-Scope: None Aug 02 11:01:54.302125 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: User-Agent: python-urllib3/1.26.10 Aug 02 11:01:54.302125 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Auth-Token: gAAAAABi6QKMm0zWjcrgGxsKGjmUpSACSDsl300OSZbmfbKI8W7YRiqQlsT7G2Yz8bTCtqeY5P5LouAzxFYTu1e6mP7SLmcSkT2w0SAqH9Ev0MtEiqJ7hFJOgCTtlSAmMKZk3KczE4deWY0afZWtzWq9Z6D1UUJ57x6ix6Lv8M0Q8lVdVaQlJYs Aug 02 11:01:54.302125 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Domain-Id: None Aug 02 11:01:54.302125 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Domain-Name: None Aug 02 11:01:54.302125 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Identity-Status: Confirmed Aug 02 11:01:54.302125 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Is-Admin-Project: True Aug 02 11:01:54.302125 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Project-Domain-Id: default Aug 02 11:01:54.302125 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Project-Domain-Name: Default Aug 02 11:01:54.302125 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Project-Id: 89a4a0cf1852449e8bfc59ddb5a902c1 Aug 02 11:01:54.302125 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Project-Name: tempest-AttachVolumeNegativeTest-1965368294 Aug 02 11:01:54.302125 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Role: reader,member Aug 02 11:01:54.302125 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Roles: reader,member Aug 02 11:01:54.303894 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/89a4a0cf1852449e8bfc59ddb5a902c1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2/89a4a0cf1852449e8bfc59ddb5a902c1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/89a4a0cf1852449e8bfc59ddb5a902c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.115:8080", "publicURL": "http://10.222.0.115:8080/v1/AUTH_89a4a0cf1852449e8bfc59ddb5a902c1"}]}] Aug 02 11:01:54.303894 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Tenant: tempest-AttachVolumeNegativeTest-1965368294 Aug 02 11:01:54.303894 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Tenant-Id: 89a4a0cf1852449e8bfc59ddb5a902c1 Aug 02 11:01:54.303894 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1965368294 Aug 02 11:01:54.303894 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User: tempest-AttachVolumeNegativeTest-1965368294-project Aug 02 11:01:54.303894 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User-Domain-Id: default Aug 02 11:01:54.303894 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User-Domain-Name: Default Aug 02 11:01:54.303894 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User-Id: 53bc14ada1564911b2f0a698aef3f333 Aug 02 11:01:54.303894 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User-Name: tempest-AttachVolumeNegativeTest-1965368294-project Aug 02 11:01:54.303894 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: method: > Aug 02 11:01:54.303894 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: exception: Instance a780ca09-3975-44eb-9464-355460c10686 could not be found. Aug 02 11:01:54.303894 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: action_args: {'id': 'a780ca09-3975-44eb-9464-355460c10686'} Aug 02 11:01:54.305748 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 11:01:54.305748 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:01:54.305748 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 11:01:54.305748 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 11:01:54.305748 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 11:01:54.305748 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 11:01:54.305748 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 11:01:54.305748 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 11:01:54.305748 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 11:01:54.305748 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 11:01:54.305748 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a780ca09-3975-44eb-9464-355460c10686 could not be found. Aug 02 11:01:54.305748 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 11:01:54.305748 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 11:01:54.305748 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 11:01:54.305748 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:01:54.305748 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 11:01:54.305748 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 11:01:54.305748 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 11:01:54.305748 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 11:01:54.305748 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 11:01:54.307639 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 11:01:54.307639 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 11:01:54.307639 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 11:01:54.307639 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 11:01:54.307639 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 11:01:54.307639 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 11:01:54.307639 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 11:01:54.307639 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 11:01:54.307639 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 11:01:54.307639 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a780ca09-3975-44eb-9464-355460c10686 could not be found. Aug 02 11:01:54.307639 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 11:01:54.307639 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 11:01:54.307639 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 11:01:54.307639 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:01:54.307639 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 11:01:54.307639 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 11:01:54.307639 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 11:01:54.307639 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 11:01:54.307639 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a780ca09-3975-44eb-9464-355460c10686 could not be found. Aug 02 11:01:54.307639 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 11:01:54.310218 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-7749af36-07a6-4f33-9060-85fc7085c734 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Returning 404 to user: Instance a780ca09-3975-44eb-9464-355460c10686 could not be found. {{(pid=129952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 11:01:54.310218 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-7749af36-07a6-4f33-9060-85fc7085c734 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "DELETE /compute/v2.1/servers/a780ca09-3975-44eb-9464-355460c10686" status: 404 len: 111 microversion: 2.1 time: 0.030428 Aug 02 11:01:54.310218 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 431/877] 10.222.0.115 () {58 vars in 1244 bytes} [Tue Aug 2 11:01:54 2022] DELETE /compute/v2.1/servers/a780ca09-3975-44eb-9464-355460c10686 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 11:01:54.312706 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-6d91cded-4cee-4184-9427-6a7a8c262f5f tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:54.313306 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-6d91cded-4cee-4184-9427-6a7a8c262f5f tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: a780ca09-3975-44eb-9464-355460c10686] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:54.319627 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-6d91cded-4cee-4184-9427-6a7a8c262f5f tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:54.320115 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-6d91cded-4cee-4184-9427-6a7a8c262f5f tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:54.320821 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-6d91cded-4cee-4184-9427-6a7a8c262f5f tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:54.321503 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-6d91cded-4cee-4184-9427-6a7a8c262f5f tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:54.336439 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.wsgi [None req-6d91cded-4cee-4184-9427-6a7a8c262f5f tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] HTTP exception thrown: Instance a780ca09-3975-44eb-9464-355460c10686 could not be found. Aug 02 11:01:54.338034 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-6d91cded-4cee-4184-9427-6a7a8c262f5f tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Request method failure captured: Aug 02 11:01:54.338034 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: request: GET /compute/v2.1/servers/a780ca09-3975-44eb-9464-355460c10686 HTTP/1.1 Aug 02 11:01:54.338034 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Accept: application/json Aug 02 11:01:54.338034 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Accept-Encoding: identity Aug 02 11:01:54.338034 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Connection: close Aug 02 11:01:54.338034 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Content-Length: 0 Aug 02 11:01:54.338034 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Content-Type: application/json Aug 02 11:01:54.338034 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Host: 10.222.0.115 Aug 02 11:01:54.338034 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Openstack-System-Scope: None Aug 02 11:01:54.338034 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: User-Agent: python-urllib3/1.26.10 Aug 02 11:01:54.338034 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Auth-Token: gAAAAABi6QKMm0zWjcrgGxsKGjmUpSACSDsl300OSZbmfbKI8W7YRiqQlsT7G2Yz8bTCtqeY5P5LouAzxFYTu1e6mP7SLmcSkT2w0SAqH9Ev0MtEiqJ7hFJOgCTtlSAmMKZk3KczE4deWY0afZWtzWq9Z6D1UUJ57x6ix6Lv8M0Q8lVdVaQlJYs Aug 02 11:01:54.338034 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Domain-Id: None Aug 02 11:01:54.338034 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Domain-Name: None Aug 02 11:01:54.338034 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Identity-Status: Confirmed Aug 02 11:01:54.338034 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Is-Admin-Project: True Aug 02 11:01:54.338034 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Project-Domain-Id: default Aug 02 11:01:54.338034 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Project-Domain-Name: Default Aug 02 11:01:54.338034 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Project-Id: 89a4a0cf1852449e8bfc59ddb5a902c1 Aug 02 11:01:54.338034 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Project-Name: tempest-AttachVolumeNegativeTest-1965368294 Aug 02 11:01:54.338034 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Role: reader,member Aug 02 11:01:54.338034 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Roles: reader,member Aug 02 11:01:54.340573 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/89a4a0cf1852449e8bfc59ddb5a902c1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2/89a4a0cf1852449e8bfc59ddb5a902c1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/89a4a0cf1852449e8bfc59ddb5a902c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.115:8080", "publicURL": "http://10.222.0.115:8080/v1/AUTH_89a4a0cf1852449e8bfc59ddb5a902c1"}]}] Aug 02 11:01:54.340573 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Tenant: tempest-AttachVolumeNegativeTest-1965368294 Aug 02 11:01:54.340573 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Tenant-Id: 89a4a0cf1852449e8bfc59ddb5a902c1 Aug 02 11:01:54.340573 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1965368294 Aug 02 11:01:54.340573 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User: tempest-AttachVolumeNegativeTest-1965368294-project Aug 02 11:01:54.340573 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User-Domain-Id: default Aug 02 11:01:54.340573 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User-Domain-Name: Default Aug 02 11:01:54.340573 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User-Id: 53bc14ada1564911b2f0a698aef3f333 Aug 02 11:01:54.340573 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User-Name: tempest-AttachVolumeNegativeTest-1965368294-project Aug 02 11:01:54.340573 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: method: > Aug 02 11:01:54.340573 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: exception: Instance a780ca09-3975-44eb-9464-355460c10686 could not be found. Aug 02 11:01:54.340573 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: action_args: {'id': 'a780ca09-3975-44eb-9464-355460c10686'} Aug 02 11:01:54.341551 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 11:01:54.341551 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:01:54.341551 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 11:01:54.341551 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 11:01:54.341551 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 11:01:54.341551 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 11:01:54.341551 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 11:01:54.341551 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 11:01:54.341551 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 11:01:54.341551 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 11:01:54.341551 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a780ca09-3975-44eb-9464-355460c10686 could not be found. Aug 02 11:01:54.341551 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 11:01:54.341551 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 11:01:54.341551 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 11:01:54.341551 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:01:54.341551 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 11:01:54.341551 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 11:01:54.341551 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 11:01:54.341551 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 11:01:54.341551 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 11:01:54.343163 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 11:01:54.343163 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 11:01:54.343163 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 11:01:54.343163 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 11:01:54.343163 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 11:01:54.343163 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 11:01:54.343163 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 11:01:54.343163 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a780ca09-3975-44eb-9464-355460c10686 could not be found. Aug 02 11:01:54.343163 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 11:01:54.343163 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 11:01:54.343163 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 11:01:54.343163 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:01:54.343163 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 11:01:54.343163 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 11:01:54.343163 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 11:01:54.343163 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 11:01:54.343163 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a780ca09-3975-44eb-9464-355460c10686 could not be found. Aug 02 11:01:54.343163 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 11:01:54.356488 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-6d91cded-4cee-4184-9427-6a7a8c262f5f tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Returning 404 to user: Instance a780ca09-3975-44eb-9464-355460c10686 could not be found. {{(pid=129953) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 11:01:54.356488 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-6d91cded-4cee-4184-9427-6a7a8c262f5f tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "GET /compute/v2.1/servers/a780ca09-3975-44eb-9464-355460c10686" status: 404 len: 111 microversion: 2.1 time: 0.031118 Aug 02 11:01:54.356488 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 447/878] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:01:54 2022] GET /compute/v2.1/servers/a780ca09-3975-44eb-9464-355460c10686 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 02 11:01:54.356763 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-a9f15400-04de-417f-a1f3-d32c6426d550 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:54.356763 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-a9f15400-04de-417f-a1f3-d32c6426d550 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: 9a2aa113-3a93-47a7-8b8f-82761ec366e5] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:54.356763 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-a9f15400-04de-417f-a1f3-d32c6426d550 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:54.356763 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-a9f15400-04de-417f-a1f3-d32c6426d550 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:54.357114 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-a9f15400-04de-417f-a1f3-d32c6426d550 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:54.357455 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-a9f15400-04de-417f-a1f3-d32c6426d550 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:54.370815 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.wsgi [None req-a9f15400-04de-417f-a1f3-d32c6426d550 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] HTTP exception thrown: Instance 9a2aa113-3a93-47a7-8b8f-82761ec366e5 could not be found. Aug 02 11:01:54.372470 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-a9f15400-04de-417f-a1f3-d32c6426d550 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Request method failure captured: Aug 02 11:01:54.372470 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: request: DELETE /compute/v2.1/servers/9a2aa113-3a93-47a7-8b8f-82761ec366e5 HTTP/1.1 Aug 02 11:01:54.372470 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Accept: application/json Aug 02 11:01:54.372470 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Accept-Encoding: identity Aug 02 11:01:54.372470 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Connection: close Aug 02 11:01:54.372470 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Content-Length: 0 Aug 02 11:01:54.372470 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Content-Type: application/json Aug 02 11:01:54.372470 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Host: 10.222.0.115 Aug 02 11:01:54.372470 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Openstack-System-Scope: None Aug 02 11:01:54.372470 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: User-Agent: python-urllib3/1.26.10 Aug 02 11:01:54.372470 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Auth-Token: gAAAAABi6QKMm0zWjcrgGxsKGjmUpSACSDsl300OSZbmfbKI8W7YRiqQlsT7G2Yz8bTCtqeY5P5LouAzxFYTu1e6mP7SLmcSkT2w0SAqH9Ev0MtEiqJ7hFJOgCTtlSAmMKZk3KczE4deWY0afZWtzWq9Z6D1UUJ57x6ix6Lv8M0Q8lVdVaQlJYs Aug 02 11:01:54.372470 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Domain-Id: None Aug 02 11:01:54.372470 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Domain-Name: None Aug 02 11:01:54.372470 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Identity-Status: Confirmed Aug 02 11:01:54.372470 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Is-Admin-Project: True Aug 02 11:01:54.372470 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Project-Domain-Id: default Aug 02 11:01:54.372470 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Project-Domain-Name: Default Aug 02 11:01:54.372470 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Project-Id: 89a4a0cf1852449e8bfc59ddb5a902c1 Aug 02 11:01:54.372470 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Project-Name: tempest-AttachVolumeNegativeTest-1965368294 Aug 02 11:01:54.372470 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Role: reader,member Aug 02 11:01:54.372470 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Roles: reader,member Aug 02 11:01:54.375082 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/89a4a0cf1852449e8bfc59ddb5a902c1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2/89a4a0cf1852449e8bfc59ddb5a902c1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/89a4a0cf1852449e8bfc59ddb5a902c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.115:8080", "publicURL": "http://10.222.0.115:8080/v1/AUTH_89a4a0cf1852449e8bfc59ddb5a902c1"}]}] Aug 02 11:01:54.375082 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Tenant: tempest-AttachVolumeNegativeTest-1965368294 Aug 02 11:01:54.375082 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Tenant-Id: 89a4a0cf1852449e8bfc59ddb5a902c1 Aug 02 11:01:54.375082 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1965368294 Aug 02 11:01:54.375082 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User: tempest-AttachVolumeNegativeTest-1965368294-project Aug 02 11:01:54.375082 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User-Domain-Id: default Aug 02 11:01:54.375082 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User-Domain-Name: Default Aug 02 11:01:54.375082 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User-Id: 53bc14ada1564911b2f0a698aef3f333 Aug 02 11:01:54.375082 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User-Name: tempest-AttachVolumeNegativeTest-1965368294-project Aug 02 11:01:54.375082 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: method: > Aug 02 11:01:54.375082 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: exception: Instance 9a2aa113-3a93-47a7-8b8f-82761ec366e5 could not be found. Aug 02 11:01:54.375082 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: action_args: {'id': '9a2aa113-3a93-47a7-8b8f-82761ec366e5'} Aug 02 11:01:54.376745 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 11:01:54.376745 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:01:54.376745 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 11:01:54.376745 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 11:01:54.376745 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 11:01:54.376745 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 11:01:54.376745 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 11:01:54.376745 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 11:01:54.376745 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 11:01:54.376745 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 11:01:54.376745 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a2aa113-3a93-47a7-8b8f-82761ec366e5 could not be found. Aug 02 11:01:54.376745 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 11:01:54.376745 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 11:01:54.376745 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 11:01:54.376745 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:01:54.376745 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 11:01:54.376745 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 11:01:54.376745 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 11:01:54.376745 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 11:01:54.376745 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 11:01:54.384801 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 11:01:54.384801 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 11:01:54.384801 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 11:01:54.384801 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 11:01:54.384801 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 11:01:54.384801 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 11:01:54.384801 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 11:01:54.384801 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 11:01:54.384801 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 11:01:54.384801 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a2aa113-3a93-47a7-8b8f-82761ec366e5 could not be found. Aug 02 11:01:54.384801 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 11:01:54.384801 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 11:01:54.384801 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 11:01:54.384801 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:01:54.384801 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 11:01:54.384801 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 11:01:54.384801 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 11:01:54.384801 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 11:01:54.384801 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a2aa113-3a93-47a7-8b8f-82761ec366e5 could not be found. Aug 02 11:01:54.384801 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 11:01:54.388049 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-a9f15400-04de-417f-a1f3-d32c6426d550 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Returning 404 to user: Instance 9a2aa113-3a93-47a7-8b8f-82761ec366e5 could not be found. {{(pid=129952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 11:01:54.388049 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-a9f15400-04de-417f-a1f3-d32c6426d550 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "DELETE /compute/v2.1/servers/9a2aa113-3a93-47a7-8b8f-82761ec366e5" status: 404 len: 111 microversion: 2.1 time: 0.028966 Aug 02 11:01:54.388049 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 432/879] 10.222.0.115 () {58 vars in 1244 bytes} [Tue Aug 2 11:01:54 2022] DELETE /compute/v2.1/servers/9a2aa113-3a93-47a7-8b8f-82761ec366e5 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 11:01:54.388372 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-a52eb878-bb74-47c6-8ba5-321e11c3b30e tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:54.388372 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-a52eb878-bb74-47c6-8ba5-321e11c3b30e tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: 9a2aa113-3a93-47a7-8b8f-82761ec366e5] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:54.391392 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-a52eb878-bb74-47c6-8ba5-321e11c3b30e tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:54.391838 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-a52eb878-bb74-47c6-8ba5-321e11c3b30e tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:54.392600 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-a52eb878-bb74-47c6-8ba5-321e11c3b30e tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:54.393027 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-a52eb878-bb74-47c6-8ba5-321e11c3b30e tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:54.408931 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.wsgi [None req-a52eb878-bb74-47c6-8ba5-321e11c3b30e tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] HTTP exception thrown: Instance 9a2aa113-3a93-47a7-8b8f-82761ec366e5 could not be found. Aug 02 11:01:54.410473 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-a52eb878-bb74-47c6-8ba5-321e11c3b30e tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Request method failure captured: Aug 02 11:01:54.410473 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: request: GET /compute/v2.1/servers/9a2aa113-3a93-47a7-8b8f-82761ec366e5 HTTP/1.1 Aug 02 11:01:54.410473 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Accept: application/json Aug 02 11:01:54.410473 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Accept-Encoding: identity Aug 02 11:01:54.410473 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Connection: close Aug 02 11:01:54.410473 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Content-Length: 0 Aug 02 11:01:54.410473 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Content-Type: application/json Aug 02 11:01:54.410473 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Host: 10.222.0.115 Aug 02 11:01:54.410473 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Openstack-System-Scope: None Aug 02 11:01:54.410473 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: User-Agent: python-urllib3/1.26.10 Aug 02 11:01:54.410473 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Auth-Token: gAAAAABi6QKMm0zWjcrgGxsKGjmUpSACSDsl300OSZbmfbKI8W7YRiqQlsT7G2Yz8bTCtqeY5P5LouAzxFYTu1e6mP7SLmcSkT2w0SAqH9Ev0MtEiqJ7hFJOgCTtlSAmMKZk3KczE4deWY0afZWtzWq9Z6D1UUJ57x6ix6Lv8M0Q8lVdVaQlJYs Aug 02 11:01:54.410473 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Domain-Id: None Aug 02 11:01:54.410473 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Domain-Name: None Aug 02 11:01:54.410473 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Identity-Status: Confirmed Aug 02 11:01:54.410473 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Is-Admin-Project: True Aug 02 11:01:54.410473 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Project-Domain-Id: default Aug 02 11:01:54.410473 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Project-Domain-Name: Default Aug 02 11:01:54.410473 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Project-Id: 89a4a0cf1852449e8bfc59ddb5a902c1 Aug 02 11:01:54.410473 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Project-Name: tempest-AttachVolumeNegativeTest-1965368294 Aug 02 11:01:54.410473 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Role: reader,member Aug 02 11:01:54.410473 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Roles: reader,member Aug 02 11:01:54.411925 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/89a4a0cf1852449e8bfc59ddb5a902c1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2/89a4a0cf1852449e8bfc59ddb5a902c1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/89a4a0cf1852449e8bfc59ddb5a902c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.115:8080", "publicURL": "http://10.222.0.115:8080/v1/AUTH_89a4a0cf1852449e8bfc59ddb5a902c1"}]}] Aug 02 11:01:54.411925 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Tenant: tempest-AttachVolumeNegativeTest-1965368294 Aug 02 11:01:54.411925 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Tenant-Id: 89a4a0cf1852449e8bfc59ddb5a902c1 Aug 02 11:01:54.411925 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1965368294 Aug 02 11:01:54.411925 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User: tempest-AttachVolumeNegativeTest-1965368294-project Aug 02 11:01:54.411925 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User-Domain-Id: default Aug 02 11:01:54.411925 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User-Domain-Name: Default Aug 02 11:01:54.411925 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User-Id: 53bc14ada1564911b2f0a698aef3f333 Aug 02 11:01:54.411925 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User-Name: tempest-AttachVolumeNegativeTest-1965368294-project Aug 02 11:01:54.411925 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: method: > Aug 02 11:01:54.411925 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: exception: Instance 9a2aa113-3a93-47a7-8b8f-82761ec366e5 could not be found. Aug 02 11:01:54.411925 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: action_args: {'id': '9a2aa113-3a93-47a7-8b8f-82761ec366e5'} Aug 02 11:01:54.412835 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 11:01:54.412835 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:01:54.412835 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 11:01:54.412835 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 11:01:54.412835 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 11:01:54.412835 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 11:01:54.412835 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 11:01:54.412835 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 11:01:54.412835 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 11:01:54.412835 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 11:01:54.412835 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a2aa113-3a93-47a7-8b8f-82761ec366e5 could not be found. Aug 02 11:01:54.412835 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 11:01:54.412835 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 11:01:54.412835 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 11:01:54.412835 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:01:54.412835 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 11:01:54.412835 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 11:01:54.412835 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 11:01:54.412835 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 11:01:54.412835 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 11:01:54.414936 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 11:01:54.414936 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 11:01:54.414936 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 11:01:54.414936 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 11:01:54.414936 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 11:01:54.414936 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 11:01:54.414936 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 11:01:54.414936 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a2aa113-3a93-47a7-8b8f-82761ec366e5 could not be found. Aug 02 11:01:54.414936 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 11:01:54.414936 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 11:01:54.414936 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 11:01:54.414936 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:01:54.414936 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 11:01:54.414936 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 11:01:54.414936 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 11:01:54.414936 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 11:01:54.414936 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a2aa113-3a93-47a7-8b8f-82761ec366e5 could not be found. Aug 02 11:01:54.414936 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 11:01:54.420038 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-a52eb878-bb74-47c6-8ba5-321e11c3b30e tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Returning 404 to user: Instance 9a2aa113-3a93-47a7-8b8f-82761ec366e5 could not be found. {{(pid=129953) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 11:01:54.420038 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-a52eb878-bb74-47c6-8ba5-321e11c3b30e tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "GET /compute/v2.1/servers/9a2aa113-3a93-47a7-8b8f-82761ec366e5" status: 404 len: 111 microversion: 2.1 time: 0.032687 Aug 02 11:01:54.420038 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 448/880] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:01:54 2022] GET /compute/v2.1/servers/9a2aa113-3a93-47a7-8b8f-82761ec366e5 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 11:01:55.105290 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-b8e8146f-18d0-4251-afb9-2010c649d5d4 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:55.105988 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-b8e8146f-18d0-4251-afb9-2010c649d5d4 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: f86a8852-12b8-46d3-bd9b-bc140757b4c5] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:55.113106 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-b8e8146f-18d0-4251-afb9-2010c649d5d4 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:55.113562 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-b8e8146f-18d0-4251-afb9-2010c649d5d4 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:55.114327 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-b8e8146f-18d0-4251-afb9-2010c649d5d4 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:55.114763 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-b8e8146f-18d0-4251-afb9-2010c649d5d4 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:55.224675 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-b8e8146f-18d0-4251-afb9-2010c649d5d4 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:01:55.235686 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-b8e8146f-18d0-4251-afb9-2010c649d5d4 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:01:55.255443 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-b8e8146f-18d0-4251-afb9-2010c649d5d4 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab1211acdd9a4df48c46f8807ed00063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3a294d5d02485980c82f065ee76bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:01:55.255443 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-b8e8146f-18d0-4251-afb9-2010c649d5d4 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5" status: 200 len: 1659 microversion: 2.20 time: 0.137688 Aug 02 11:01:55.255443 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 433/881] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 11:01:55 2022] GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5 => generated 1659 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 11:01:55.467377 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [req-b891dc20-6817-43e3-94fc-750d500aabae req-68411041-7b44-4c9d-a8ec-bea2ca77f592 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f86a8852-12b8-46d3-bd9b-bc140757b4c5", "name": "network-vif-deleted", "tag": "b19c6f76-3eb2-428e-95c9-247e8c1ea7c5"}]} {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 11:01:55.482358 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [req-b891dc20-6817-43e3-94fc-750d500aabae req-68411041-7b44-4c9d-a8ec-bea2ca77f592 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:55.485296 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [req-b891dc20-6817-43e3-94fc-750d500aabae req-68411041-7b44-4c9d-a8ec-bea2ca77f592 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:55.500272 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.compute.server_external_events [req-b891dc20-6817-43e3-94fc-750d500aabae req-68411041-7b44-4c9d-a8ec-bea2ca77f592 service nova] Creating event network-vif-deleted:b19c6f76-3eb2-428e-95c9-247e8c1ea7c5 for instance f86a8852-12b8-46d3-bd9b-bc140757b4c5 on hv-cinder-85031 Aug 02 11:01:55.502553 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-84debc0b-622f-4838-a5c8-4d2e74f65b15 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:55.503673 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-84debc0b-622f-4838-a5c8-4d2e74f65b15 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] [instance: 3938932a-e778-4c0c-9ab0-78dc9082a48e] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:55.506871 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [req-b891dc20-6817-43e3-94fc-750d500aabae req-68411041-7b44-4c9d-a8ec-bea2ca77f592 service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046100 Aug 02 11:01:55.507569 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 449/882] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Aug 2 11:01:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 11:01:55.515307 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-84debc0b-622f-4838-a5c8-4d2e74f65b15 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:55.523099 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-84debc0b-622f-4838-a5c8-4d2e74f65b15 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:55.523099 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-84debc0b-622f-4838-a5c8-4d2e74f65b15 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:55.523099 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-84debc0b-622f-4838-a5c8-4d2e74f65b15 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:55.536708 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.wsgi [None req-84debc0b-622f-4838-a5c8-4d2e74f65b15 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] HTTP exception thrown: Instance 3938932a-e778-4c0c-9ab0-78dc9082a48e could not be found. Aug 02 11:01:55.538635 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-84debc0b-622f-4838-a5c8-4d2e74f65b15 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Request method failure captured: Aug 02 11:01:55.538635 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: request: DELETE /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e HTTP/1.1 Aug 02 11:01:55.538635 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Accept: application/json Aug 02 11:01:55.538635 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Accept-Encoding: identity Aug 02 11:01:55.538635 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Connection: close Aug 02 11:01:55.538635 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Content-Length: 0 Aug 02 11:01:55.538635 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Content-Type: application/json Aug 02 11:01:55.538635 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Host: 10.222.0.115 Aug 02 11:01:55.538635 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Openstack-System-Scope: None Aug 02 11:01:55.538635 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: User-Agent: python-urllib3/1.26.10 Aug 02 11:01:55.538635 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Auth-Token: gAAAAABi6QKP2ZooXwKqX5KvPH3An3wyIoIsMgqpY1U6hmfsdfbyQPM8SwHstppNJS_IdskheOf_4r6IRhjVVcUg3tpKtkcShi4vzFBP96Mmoq9msduhL-i8w55s44Ke6IYK5jxLjLnFmn9xEdrciTrqBmIOO8O7BC5NmiD-a-j9BHWvNFOt1U0 Aug 02 11:01:55.538635 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Domain-Id: None Aug 02 11:01:55.538635 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Domain-Name: None Aug 02 11:01:55.538635 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Identity-Status: Confirmed Aug 02 11:01:55.538635 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Is-Admin-Project: True Aug 02 11:01:55.538635 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Project-Domain-Id: default Aug 02 11:01:55.538635 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Project-Domain-Name: Default Aug 02 11:01:55.538635 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Project-Id: 302e92110a1545f1b84644b8971bb6eb Aug 02 11:01:55.538635 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Project-Name: tempest-AttachVolumeTestJSON-322964104 Aug 02 11:01:55.538635 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Role: reader,member Aug 02 11:01:55.538635 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Roles: reader,member Aug 02 11:01:55.545207 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/302e92110a1545f1b84644b8971bb6eb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2/302e92110a1545f1b84644b8971bb6eb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/302e92110a1545f1b84644b8971bb6eb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.115:8080", "publicURL": "http://10.222.0.115:8080/v1/AUTH_302e92110a1545f1b84644b8971bb6eb"}]}] Aug 02 11:01:55.545207 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Tenant: tempest-AttachVolumeTestJSON-322964104 Aug 02 11:01:55.545207 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Tenant-Id: 302e92110a1545f1b84644b8971bb6eb Aug 02 11:01:55.545207 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Tenant-Name: tempest-AttachVolumeTestJSON-322964104 Aug 02 11:01:55.545207 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User: tempest-AttachVolumeTestJSON-322964104-project Aug 02 11:01:55.545207 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User-Domain-Id: default Aug 02 11:01:55.545207 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User-Domain-Name: Default Aug 02 11:01:55.545207 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User-Id: f3f41f17f5154e01a699043edc350cf8 Aug 02 11:01:55.545207 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User-Name: tempest-AttachVolumeTestJSON-322964104-project Aug 02 11:01:55.545207 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: method: > Aug 02 11:01:55.545207 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: exception: Instance 3938932a-e778-4c0c-9ab0-78dc9082a48e could not be found. Aug 02 11:01:55.545207 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: action_args: {'id': '3938932a-e778-4c0c-9ab0-78dc9082a48e'} Aug 02 11:01:55.546022 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 11:01:55.546022 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:01:55.546022 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 11:01:55.546022 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 11:01:55.546022 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 11:01:55.546022 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 11:01:55.546022 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 11:01:55.546022 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 11:01:55.546022 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 11:01:55.546022 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 11:01:55.546022 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3938932a-e778-4c0c-9ab0-78dc9082a48e could not be found. Aug 02 11:01:55.546022 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 11:01:55.546022 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 11:01:55.546022 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 11:01:55.546022 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:01:55.546022 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 11:01:55.546022 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 11:01:55.546022 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 11:01:55.546022 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 11:01:55.546022 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 11:01:55.548060 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 11:01:55.548060 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 11:01:55.548060 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 11:01:55.548060 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 11:01:55.548060 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 11:01:55.548060 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 11:01:55.548060 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 11:01:55.548060 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 11:01:55.548060 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 11:01:55.548060 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3938932a-e778-4c0c-9ab0-78dc9082a48e could not be found. Aug 02 11:01:55.548060 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 11:01:55.548060 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 11:01:55.548060 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 11:01:55.548060 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:01:55.548060 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 11:01:55.548060 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 11:01:55.548060 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 11:01:55.548060 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 11:01:55.548060 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3938932a-e778-4c0c-9ab0-78dc9082a48e could not be found. Aug 02 11:01:55.548060 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 11:01:55.549761 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-84debc0b-622f-4838-a5c8-4d2e74f65b15 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Returning 404 to user: Instance 3938932a-e778-4c0c-9ab0-78dc9082a48e could not be found. {{(pid=129952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 11:01:55.549761 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-84debc0b-622f-4838-a5c8-4d2e74f65b15 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] 10.222.0.115 "DELETE /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e" status: 404 len: 111 microversion: 2.1 time: 0.043752 Aug 02 11:01:55.549761 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 434/883] 10.222.0.115 () {58 vars in 1244 bytes} [Tue Aug 2 11:01:55 2022] DELETE /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 02 11:01:55.568505 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-8a28e61e-ce07-4aef-a095-4c64ce027fb7 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:55.569277 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-8a28e61e-ce07-4aef-a095-4c64ce027fb7 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] [instance: 3938932a-e778-4c0c-9ab0-78dc9082a48e] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:55.576899 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-8a28e61e-ce07-4aef-a095-4c64ce027fb7 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:55.577358 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-8a28e61e-ce07-4aef-a095-4c64ce027fb7 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:55.578203 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-8a28e61e-ce07-4aef-a095-4c64ce027fb7 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:55.578647 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-8a28e61e-ce07-4aef-a095-4c64ce027fb7 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:55.599905 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.wsgi [None req-8a28e61e-ce07-4aef-a095-4c64ce027fb7 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] HTTP exception thrown: Instance 3938932a-e778-4c0c-9ab0-78dc9082a48e could not be found. Aug 02 11:01:55.601932 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-8a28e61e-ce07-4aef-a095-4c64ce027fb7 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Request method failure captured: Aug 02 11:01:55.601932 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: request: GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e HTTP/1.1 Aug 02 11:01:55.601932 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Accept: application/json Aug 02 11:01:55.601932 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Accept-Encoding: identity Aug 02 11:01:55.601932 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Connection: close Aug 02 11:01:55.601932 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Content-Length: 0 Aug 02 11:01:55.601932 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Content-Type: application/json Aug 02 11:01:55.601932 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Host: 10.222.0.115 Aug 02 11:01:55.601932 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Openstack-System-Scope: None Aug 02 11:01:55.601932 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: User-Agent: python-urllib3/1.26.10 Aug 02 11:01:55.601932 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Auth-Token: gAAAAABi6QKP2ZooXwKqX5KvPH3An3wyIoIsMgqpY1U6hmfsdfbyQPM8SwHstppNJS_IdskheOf_4r6IRhjVVcUg3tpKtkcShi4vzFBP96Mmoq9msduhL-i8w55s44Ke6IYK5jxLjLnFmn9xEdrciTrqBmIOO8O7BC5NmiD-a-j9BHWvNFOt1U0 Aug 02 11:01:55.601932 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Domain-Id: None Aug 02 11:01:55.601932 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Domain-Name: None Aug 02 11:01:55.601932 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Identity-Status: Confirmed Aug 02 11:01:55.601932 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Is-Admin-Project: True Aug 02 11:01:55.601932 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Project-Domain-Id: default Aug 02 11:01:55.601932 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Project-Domain-Name: Default Aug 02 11:01:55.601932 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Project-Id: 302e92110a1545f1b84644b8971bb6eb Aug 02 11:01:55.601932 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Project-Name: tempest-AttachVolumeTestJSON-322964104 Aug 02 11:01:55.601932 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Role: reader,member Aug 02 11:01:55.601932 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Roles: reader,member Aug 02 11:01:55.603583 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/302e92110a1545f1b84644b8971bb6eb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2/302e92110a1545f1b84644b8971bb6eb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/302e92110a1545f1b84644b8971bb6eb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.115:8080", "publicURL": "http://10.222.0.115:8080/v1/AUTH_302e92110a1545f1b84644b8971bb6eb"}]}] Aug 02 11:01:55.603583 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Tenant: tempest-AttachVolumeTestJSON-322964104 Aug 02 11:01:55.603583 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Tenant-Id: 302e92110a1545f1b84644b8971bb6eb Aug 02 11:01:55.603583 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Tenant-Name: tempest-AttachVolumeTestJSON-322964104 Aug 02 11:01:55.603583 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User: tempest-AttachVolumeTestJSON-322964104-project Aug 02 11:01:55.603583 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User-Domain-Id: default Aug 02 11:01:55.603583 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User-Domain-Name: Default Aug 02 11:01:55.603583 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User-Id: f3f41f17f5154e01a699043edc350cf8 Aug 02 11:01:55.603583 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User-Name: tempest-AttachVolumeTestJSON-322964104-project Aug 02 11:01:55.603583 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: method: > Aug 02 11:01:55.603583 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: exception: Instance 3938932a-e778-4c0c-9ab0-78dc9082a48e could not be found. Aug 02 11:01:55.603583 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: action_args: {'id': '3938932a-e778-4c0c-9ab0-78dc9082a48e'} Aug 02 11:01:55.604428 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 11:01:55.604428 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:01:55.604428 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 11:01:55.604428 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 11:01:55.604428 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 11:01:55.604428 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 11:01:55.604428 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 11:01:55.604428 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 11:01:55.604428 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 11:01:55.604428 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 11:01:55.604428 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3938932a-e778-4c0c-9ab0-78dc9082a48e could not be found. Aug 02 11:01:55.604428 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 11:01:55.604428 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 11:01:55.604428 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 11:01:55.604428 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:01:55.604428 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 11:01:55.604428 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 11:01:55.604428 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 11:01:55.604428 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 11:01:55.604428 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 11:01:55.606616 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 11:01:55.606616 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 11:01:55.606616 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 11:01:55.606616 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 11:01:55.606616 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 11:01:55.606616 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 11:01:55.606616 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 11:01:55.606616 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3938932a-e778-4c0c-9ab0-78dc9082a48e could not be found. Aug 02 11:01:55.606616 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 11:01:55.606616 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 11:01:55.606616 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 11:01:55.606616 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:01:55.606616 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 11:01:55.606616 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 11:01:55.606616 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 11:01:55.606616 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 11:01:55.606616 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3938932a-e778-4c0c-9ab0-78dc9082a48e could not be found. Aug 02 11:01:55.606616 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 11:01:55.607726 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-8a28e61e-ce07-4aef-a095-4c64ce027fb7 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] Returning 404 to user: Instance 3938932a-e778-4c0c-9ab0-78dc9082a48e could not be found. {{(pid=129953) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 11:01:55.607726 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-8a28e61e-ce07-4aef-a095-4c64ce027fb7 tempest-AttachVolumeTestJSON-322964104 tempest-AttachVolumeTestJSON-322964104-project] 10.222.0.115 "GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e" status: 404 len: 111 microversion: 2.1 time: 0.049941 Aug 02 11:01:55.607726 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 450/884] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:01:55 2022] GET /compute/v2.1/servers/3938932a-e778-4c0c-9ab0-78dc9082a48e => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 11:01:55.729836 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-f3315081-4b60-4789-91c8-be3d9d4a9590 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:55.729836 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-f3315081-4b60-4789-91c8-be3d9d4a9590 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: 8a7b8f4c-0c11-406f-bed6-b4fd18e3c304] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:55.737660 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-f3315081-4b60-4789-91c8-be3d9d4a9590 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:55.740077 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-f3315081-4b60-4789-91c8-be3d9d4a9590 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:55.741878 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-f3315081-4b60-4789-91c8-be3d9d4a9590 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:55.742386 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-f3315081-4b60-4789-91c8-be3d9d4a9590 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:55.758659 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.wsgi [None req-f3315081-4b60-4789-91c8-be3d9d4a9590 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] HTTP exception thrown: Instance 8a7b8f4c-0c11-406f-bed6-b4fd18e3c304 could not be found. Aug 02 11:01:55.760310 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-f3315081-4b60-4789-91c8-be3d9d4a9590 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Request method failure captured: Aug 02 11:01:55.760310 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: request: DELETE /compute/v2.1/servers/8a7b8f4c-0c11-406f-bed6-b4fd18e3c304 HTTP/1.1 Aug 02 11:01:55.760310 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Accept: application/json Aug 02 11:01:55.760310 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Accept-Encoding: identity Aug 02 11:01:55.760310 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Connection: close Aug 02 11:01:55.760310 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Content-Length: 0 Aug 02 11:01:55.760310 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Content-Type: application/json Aug 02 11:01:55.760310 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Host: 10.222.0.115 Aug 02 11:01:55.760310 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Openstack-System-Scope: None Aug 02 11:01:55.760310 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: User-Agent: python-urllib3/1.26.10 Aug 02 11:01:55.760310 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Auth-Token: gAAAAABi6QKMm0zWjcrgGxsKGjmUpSACSDsl300OSZbmfbKI8W7YRiqQlsT7G2Yz8bTCtqeY5P5LouAzxFYTu1e6mP7SLmcSkT2w0SAqH9Ev0MtEiqJ7hFJOgCTtlSAmMKZk3KczE4deWY0afZWtzWq9Z6D1UUJ57x6ix6Lv8M0Q8lVdVaQlJYs Aug 02 11:01:55.760310 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Domain-Id: None Aug 02 11:01:55.760310 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Domain-Name: None Aug 02 11:01:55.760310 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Identity-Status: Confirmed Aug 02 11:01:55.760310 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Is-Admin-Project: True Aug 02 11:01:55.760310 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Project-Domain-Id: default Aug 02 11:01:55.760310 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Project-Domain-Name: Default Aug 02 11:01:55.760310 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Project-Id: 89a4a0cf1852449e8bfc59ddb5a902c1 Aug 02 11:01:55.760310 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Project-Name: tempest-AttachVolumeNegativeTest-1965368294 Aug 02 11:01:55.760310 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Role: reader,member Aug 02 11:01:55.760310 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Roles: reader,member Aug 02 11:01:55.761824 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/89a4a0cf1852449e8bfc59ddb5a902c1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2/89a4a0cf1852449e8bfc59ddb5a902c1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/89a4a0cf1852449e8bfc59ddb5a902c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.115:8080", "publicURL": "http://10.222.0.115:8080/v1/AUTH_89a4a0cf1852449e8bfc59ddb5a902c1"}]}] Aug 02 11:01:55.761824 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Tenant: tempest-AttachVolumeNegativeTest-1965368294 Aug 02 11:01:55.761824 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Tenant-Id: 89a4a0cf1852449e8bfc59ddb5a902c1 Aug 02 11:01:55.761824 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1965368294 Aug 02 11:01:55.761824 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User: tempest-AttachVolumeNegativeTest-1965368294-project Aug 02 11:01:55.761824 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User-Domain-Id: default Aug 02 11:01:55.761824 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User-Domain-Name: Default Aug 02 11:01:55.761824 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User-Id: 53bc14ada1564911b2f0a698aef3f333 Aug 02 11:01:55.761824 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User-Name: tempest-AttachVolumeNegativeTest-1965368294-project Aug 02 11:01:55.761824 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: method: > Aug 02 11:01:55.761824 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: exception: Instance 8a7b8f4c-0c11-406f-bed6-b4fd18e3c304 could not be found. Aug 02 11:01:55.761824 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: action_args: {'id': '8a7b8f4c-0c11-406f-bed6-b4fd18e3c304'} Aug 02 11:01:55.762965 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 11:01:55.762965 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:01:55.762965 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 11:01:55.762965 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 11:01:55.762965 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 11:01:55.762965 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 11:01:55.762965 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 11:01:55.762965 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 11:01:55.762965 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 11:01:55.762965 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 11:01:55.762965 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a7b8f4c-0c11-406f-bed6-b4fd18e3c304 could not be found. Aug 02 11:01:55.762965 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 11:01:55.762965 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 11:01:55.762965 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 11:01:55.762965 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:01:55.762965 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 11:01:55.762965 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 11:01:55.762965 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 11:01:55.762965 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 11:01:55.762965 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 11:01:55.765571 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 11:01:55.765571 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 11:01:55.765571 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 11:01:55.765571 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 11:01:55.765571 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 11:01:55.765571 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 11:01:55.765571 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 11:01:55.765571 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 11:01:55.765571 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 11:01:55.765571 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a7b8f4c-0c11-406f-bed6-b4fd18e3c304 could not be found. Aug 02 11:01:55.765571 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 11:01:55.765571 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 11:01:55.765571 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 11:01:55.765571 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:01:55.765571 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 11:01:55.765571 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 11:01:55.765571 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 11:01:55.765571 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 11:01:55.765571 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a7b8f4c-0c11-406f-bed6-b4fd18e3c304 could not be found. Aug 02 11:01:55.765571 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 11:01:55.767148 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-f3315081-4b60-4789-91c8-be3d9d4a9590 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Returning 404 to user: Instance 8a7b8f4c-0c11-406f-bed6-b4fd18e3c304 could not be found. {{(pid=129952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 11:01:55.767148 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-f3315081-4b60-4789-91c8-be3d9d4a9590 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "DELETE /compute/v2.1/servers/8a7b8f4c-0c11-406f-bed6-b4fd18e3c304" status: 404 len: 111 microversion: 2.1 time: 0.040324 Aug 02 11:01:55.767148 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 435/885] 10.222.0.115 () {58 vars in 1244 bytes} [Tue Aug 2 11:01:55 2022] DELETE /compute/v2.1/servers/8a7b8f4c-0c11-406f-bed6-b4fd18e3c304 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 11:01:55.771521 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-75fce007-fad5-4b9c-af9e-dc582b2a1ab1 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:55.772132 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-75fce007-fad5-4b9c-af9e-dc582b2a1ab1 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] [instance: 8a7b8f4c-0c11-406f-bed6-b4fd18e3c304] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:55.781476 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-75fce007-fad5-4b9c-af9e-dc582b2a1ab1 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:55.781948 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-75fce007-fad5-4b9c-af9e-dc582b2a1ab1 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:55.782720 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-75fce007-fad5-4b9c-af9e-dc582b2a1ab1 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:55.783481 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-75fce007-fad5-4b9c-af9e-dc582b2a1ab1 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:55.800253 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.wsgi [None req-75fce007-fad5-4b9c-af9e-dc582b2a1ab1 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] HTTP exception thrown: Instance 8a7b8f4c-0c11-406f-bed6-b4fd18e3c304 could not be found. Aug 02 11:01:55.802612 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-75fce007-fad5-4b9c-af9e-dc582b2a1ab1 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Request method failure captured: Aug 02 11:01:55.802612 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: request: GET /compute/v2.1/servers/8a7b8f4c-0c11-406f-bed6-b4fd18e3c304 HTTP/1.1 Aug 02 11:01:55.802612 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Accept: application/json Aug 02 11:01:55.802612 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Accept-Encoding: identity Aug 02 11:01:55.802612 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Connection: close Aug 02 11:01:55.802612 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Content-Length: 0 Aug 02 11:01:55.802612 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Content-Type: application/json Aug 02 11:01:55.802612 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Host: 10.222.0.115 Aug 02 11:01:55.802612 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Openstack-System-Scope: None Aug 02 11:01:55.802612 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: User-Agent: python-urllib3/1.26.10 Aug 02 11:01:55.802612 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Auth-Token: gAAAAABi6QKMm0zWjcrgGxsKGjmUpSACSDsl300OSZbmfbKI8W7YRiqQlsT7G2Yz8bTCtqeY5P5LouAzxFYTu1e6mP7SLmcSkT2w0SAqH9Ev0MtEiqJ7hFJOgCTtlSAmMKZk3KczE4deWY0afZWtzWq9Z6D1UUJ57x6ix6Lv8M0Q8lVdVaQlJYs Aug 02 11:01:55.802612 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Domain-Id: None Aug 02 11:01:55.802612 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Domain-Name: None Aug 02 11:01:55.802612 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Identity-Status: Confirmed Aug 02 11:01:55.802612 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Is-Admin-Project: True Aug 02 11:01:55.802612 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Project-Domain-Id: default Aug 02 11:01:55.802612 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Project-Domain-Name: Default Aug 02 11:01:55.802612 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Project-Id: 89a4a0cf1852449e8bfc59ddb5a902c1 Aug 02 11:01:55.802612 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Project-Name: tempest-AttachVolumeNegativeTest-1965368294 Aug 02 11:01:55.802612 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Role: reader,member Aug 02 11:01:55.802612 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Roles: reader,member Aug 02 11:01:55.804303 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/89a4a0cf1852449e8bfc59ddb5a902c1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2/89a4a0cf1852449e8bfc59ddb5a902c1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/89a4a0cf1852449e8bfc59ddb5a902c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.115:8080", "publicURL": "http://10.222.0.115:8080/v1/AUTH_89a4a0cf1852449e8bfc59ddb5a902c1"}]}] Aug 02 11:01:55.804303 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Tenant: tempest-AttachVolumeNegativeTest-1965368294 Aug 02 11:01:55.804303 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Tenant-Id: 89a4a0cf1852449e8bfc59ddb5a902c1 Aug 02 11:01:55.804303 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1965368294 Aug 02 11:01:55.804303 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User: tempest-AttachVolumeNegativeTest-1965368294-project Aug 02 11:01:55.804303 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User-Domain-Id: default Aug 02 11:01:55.804303 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User-Domain-Name: Default Aug 02 11:01:55.804303 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User-Id: 53bc14ada1564911b2f0a698aef3f333 Aug 02 11:01:55.804303 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User-Name: tempest-AttachVolumeNegativeTest-1965368294-project Aug 02 11:01:55.804303 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: method: > Aug 02 11:01:55.804303 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: exception: Instance 8a7b8f4c-0c11-406f-bed6-b4fd18e3c304 could not be found. Aug 02 11:01:55.804303 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: action_args: {'id': '8a7b8f4c-0c11-406f-bed6-b4fd18e3c304'} Aug 02 11:01:55.805274 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 11:01:55.805274 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:01:55.805274 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 11:01:55.805274 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 11:01:55.805274 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 11:01:55.805274 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 11:01:55.805274 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 11:01:55.805274 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 11:01:55.805274 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 11:01:55.805274 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 11:01:55.805274 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a7b8f4c-0c11-406f-bed6-b4fd18e3c304 could not be found. Aug 02 11:01:55.805274 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 11:01:55.805274 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 11:01:55.805274 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 11:01:55.805274 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:01:55.805274 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 11:01:55.805274 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 11:01:55.805274 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 11:01:55.805274 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 11:01:55.805274 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 11:01:55.806927 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 11:01:55.806927 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 11:01:55.806927 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 11:01:55.806927 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 11:01:55.806927 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 11:01:55.806927 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 11:01:55.806927 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 11:01:55.806927 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a7b8f4c-0c11-406f-bed6-b4fd18e3c304 could not be found. Aug 02 11:01:55.806927 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 11:01:55.806927 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 11:01:55.806927 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 11:01:55.806927 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:01:55.806927 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 11:01:55.806927 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 11:01:55.806927 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 11:01:55.806927 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 11:01:55.806927 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a7b8f4c-0c11-406f-bed6-b4fd18e3c304 could not be found. Aug 02 11:01:55.806927 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 11:01:55.813104 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-75fce007-fad5-4b9c-af9e-dc582b2a1ab1 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] Returning 404 to user: Instance 8a7b8f4c-0c11-406f-bed6-b4fd18e3c304 could not be found. {{(pid=129953) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 11:01:55.813104 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-75fce007-fad5-4b9c-af9e-dc582b2a1ab1 tempest-AttachVolumeNegativeTest-1965368294 tempest-AttachVolumeNegativeTest-1965368294-project] 10.222.0.115 "GET /compute/v2.1/servers/8a7b8f4c-0c11-406f-bed6-b4fd18e3c304" status: 404 len: 111 microversion: 2.1 time: 0.041933 Aug 02 11:01:55.813104 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 451/886] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:01:55 2022] GET /compute/v2.1/servers/8a7b8f4c-0c11-406f-bed6-b4fd18e3c304 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 11:01:56.265530 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-76c3e96d-2a97-476a-9c9c-fd894807678a tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:56.267031 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-76c3e96d-2a97-476a-9c9c-fd894807678a tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: f86a8852-12b8-46d3-bd9b-bc140757b4c5] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:56.276066 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-76c3e96d-2a97-476a-9c9c-fd894807678a tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:56.276985 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-76c3e96d-2a97-476a-9c9c-fd894807678a tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:56.277770 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-76c3e96d-2a97-476a-9c9c-fd894807678a tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:56.278459 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-76c3e96d-2a97-476a-9c9c-fd894807678a tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:56.296313 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.wsgi [None req-76c3e96d-2a97-476a-9c9c-fd894807678a tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] HTTP exception thrown: Instance f86a8852-12b8-46d3-bd9b-bc140757b4c5 could not be found. Aug 02 11:01:56.299041 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-76c3e96d-2a97-476a-9c9c-fd894807678a tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Request method failure captured: Aug 02 11:01:56.299041 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: request: GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5 HTTP/1.1 Aug 02 11:01:56.299041 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Accept: application/json Aug 02 11:01:56.299041 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Accept-Encoding: identity Aug 02 11:01:56.299041 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Connection: close Aug 02 11:01:56.299041 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Content-Length: 0 Aug 02 11:01:56.299041 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Content-Type: application/json Aug 02 11:01:56.299041 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Host: 10.222.0.115 Aug 02 11:01:56.299041 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Openstack-System-Scope: None Aug 02 11:01:56.299041 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: User-Agent: python-urllib3/1.26.10 Aug 02 11:01:56.299041 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Auth-Token: gAAAAABi6QKPaxrUk-Rq_Ctk1SOGwm4XuIXMS_HBTTUeAPSkZXFKcj0Lxt_OaInefAqehpe4qU3OoSMMi--ESVj5jZNszpAfca9aWIuGwsIwUCQbVLiuRiX4ryZJJc4W5WY1NNrTZ9QsvW57sxv55X9CXuxJOzOet8on3cbUt2Xg-0SGLE0ilJQ Aug 02 11:01:56.299041 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Domain-Id: None Aug 02 11:01:56.299041 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Domain-Name: None Aug 02 11:01:56.299041 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Identity-Status: Confirmed Aug 02 11:01:56.299041 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Is-Admin-Project: True Aug 02 11:01:56.299041 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Openstack-Nova-Api-Version: 2.20 Aug 02 11:01:56.299041 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Project-Domain-Id: default Aug 02 11:01:56.299041 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Project-Domain-Name: Default Aug 02 11:01:56.299041 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Project-Id: 1b3a294d5d02485980c82f065ee76bd7 Aug 02 11:01:56.299041 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-209900741 Aug 02 11:01:56.299041 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Role: reader,member Aug 02 11:01:56.299041 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Roles: reader,member Aug 02 11:01:56.300974 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/1b3a294d5d02485980c82f065ee76bd7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2/1b3a294d5d02485980c82f065ee76bd7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/1b3a294d5d02485980c82f065ee76bd7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.115:8080", "publicURL": "http://10.222.0.115:8080/v1/AUTH_1b3a294d5d02485980c82f065ee76bd7"}]}] Aug 02 11:01:56.300974 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Tenant: tempest-AttachVolumeShelveTestJSON-209900741 Aug 02 11:01:56.300974 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Tenant-Id: 1b3a294d5d02485980c82f065ee76bd7 Aug 02 11:01:56.300974 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-209900741 Aug 02 11:01:56.300974 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User: tempest-AttachVolumeShelveTestJSON-209900741-project Aug 02 11:01:56.300974 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User-Domain-Id: default Aug 02 11:01:56.300974 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User-Domain-Name: Default Aug 02 11:01:56.300974 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User-Id: ab1211acdd9a4df48c46f8807ed00063 Aug 02 11:01:56.300974 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User-Name: tempest-AttachVolumeShelveTestJSON-209900741-project Aug 02 11:01:56.300974 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: method: > Aug 02 11:01:56.300974 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: exception: Instance f86a8852-12b8-46d3-bd9b-bc140757b4c5 could not be found. Aug 02 11:01:56.300974 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: action_args: {'id': 'f86a8852-12b8-46d3-bd9b-bc140757b4c5'} Aug 02 11:01:56.301917 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 11:01:56.301917 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:01:56.301917 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 11:01:56.301917 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 11:01:56.301917 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 11:01:56.301917 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 11:01:56.301917 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 11:01:56.301917 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 11:01:56.301917 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 11:01:56.301917 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 11:01:56.301917 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f86a8852-12b8-46d3-bd9b-bc140757b4c5 could not be found. Aug 02 11:01:56.301917 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 11:01:56.301917 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 11:01:56.301917 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 11:01:56.301917 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:01:56.301917 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 11:01:56.301917 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 11:01:56.301917 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 11:01:56.301917 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 11:01:56.301917 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 11:01:56.303357 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 11:01:56.303357 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 11:01:56.303357 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 11:01:56.303357 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 11:01:56.303357 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 11:01:56.303357 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 11:01:56.303357 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 11:01:56.303357 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f86a8852-12b8-46d3-bd9b-bc140757b4c5 could not be found. Aug 02 11:01:56.303357 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 11:01:56.303357 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 11:01:56.303357 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 11:01:56.303357 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:01:56.303357 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 11:01:56.303357 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 11:01:56.303357 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 11:01:56.303357 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 11:01:56.303357 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f86a8852-12b8-46d3-bd9b-bc140757b4c5 could not be found. Aug 02 11:01:56.303357 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 11:01:56.305400 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-76c3e96d-2a97-476a-9c9c-fd894807678a tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Returning 404 to user: Instance f86a8852-12b8-46d3-bd9b-bc140757b4c5 could not be found. {{(pid=129952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 11:01:56.306638 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-76c3e96d-2a97-476a-9c9c-fd894807678a tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5" status: 404 len: 111 microversion: 2.20 time: 0.047551 Aug 02 11:01:56.307877 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 436/887] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 11:01:56 2022] GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 02 11:01:56.317931 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-1a4411e9-eb8f-40fe-b543-dc7d1b738cdc tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '.version_select at 0x7f7c4e4f6d30>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:56.400968 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-1a4411e9-eb8f-40fe-b543-dc7d1b738cdc tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-805288474" status: 204 len: 0 microversion: 2.20 time: 0.087784 Aug 02 11:01:56.401548 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 452/888] 10.222.0.115 () {60 vars in 1264 bytes} [Tue Aug 2 11:01:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-805288474 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 02 11:01:59.819623 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-29eee85a-84bf-4409-b331-35284493a88b tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:59.820759 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-29eee85a-84bf-4409-b331-35284493a88b tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: f86a8852-12b8-46d3-bd9b-bc140757b4c5] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:59.828245 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-29eee85a-84bf-4409-b331-35284493a88b tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:59.828687 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-29eee85a-84bf-4409-b331-35284493a88b tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:59.829752 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-29eee85a-84bf-4409-b331-35284493a88b tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:59.830128 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-29eee85a-84bf-4409-b331-35284493a88b tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:59.846071 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.wsgi [None req-29eee85a-84bf-4409-b331-35284493a88b tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] HTTP exception thrown: Instance f86a8852-12b8-46d3-bd9b-bc140757b4c5 could not be found. Aug 02 11:01:59.847982 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-29eee85a-84bf-4409-b331-35284493a88b tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Request method failure captured: Aug 02 11:01:59.847982 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: request: DELETE /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5 HTTP/1.1 Aug 02 11:01:59.847982 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Accept: application/json Aug 02 11:01:59.847982 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Accept-Encoding: identity Aug 02 11:01:59.847982 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Connection: close Aug 02 11:01:59.847982 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Content-Length: 0 Aug 02 11:01:59.847982 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Content-Type: application/json Aug 02 11:01:59.847982 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Host: 10.222.0.115 Aug 02 11:01:59.847982 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Openstack-System-Scope: None Aug 02 11:01:59.847982 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: User-Agent: python-urllib3/1.26.10 Aug 02 11:01:59.847982 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Auth-Token: gAAAAABi6QKPaxrUk-Rq_Ctk1SOGwm4XuIXMS_HBTTUeAPSkZXFKcj0Lxt_OaInefAqehpe4qU3OoSMMi--ESVj5jZNszpAfca9aWIuGwsIwUCQbVLiuRiX4ryZJJc4W5WY1NNrTZ9QsvW57sxv55X9CXuxJOzOet8on3cbUt2Xg-0SGLE0ilJQ Aug 02 11:01:59.847982 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Domain-Id: None Aug 02 11:01:59.847982 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Domain-Name: None Aug 02 11:01:59.847982 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Identity-Status: Confirmed Aug 02 11:01:59.847982 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Is-Admin-Project: True Aug 02 11:01:59.847982 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Openstack-Nova-Api-Version: 2.20 Aug 02 11:01:59.847982 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Project-Domain-Id: default Aug 02 11:01:59.847982 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Project-Domain-Name: Default Aug 02 11:01:59.847982 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Project-Id: 1b3a294d5d02485980c82f065ee76bd7 Aug 02 11:01:59.847982 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-209900741 Aug 02 11:01:59.847982 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Role: reader,member Aug 02 11:01:59.847982 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Roles: reader,member Aug 02 11:01:59.849796 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/1b3a294d5d02485980c82f065ee76bd7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2/1b3a294d5d02485980c82f065ee76bd7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/1b3a294d5d02485980c82f065ee76bd7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.115:8080", "publicURL": "http://10.222.0.115:8080/v1/AUTH_1b3a294d5d02485980c82f065ee76bd7"}]}] Aug 02 11:01:59.849796 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Tenant: tempest-AttachVolumeShelveTestJSON-209900741 Aug 02 11:01:59.849796 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Tenant-Id: 1b3a294d5d02485980c82f065ee76bd7 Aug 02 11:01:59.849796 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-209900741 Aug 02 11:01:59.849796 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User: tempest-AttachVolumeShelveTestJSON-209900741-project Aug 02 11:01:59.849796 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User-Domain-Id: default Aug 02 11:01:59.849796 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User-Domain-Name: Default Aug 02 11:01:59.849796 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User-Id: ab1211acdd9a4df48c46f8807ed00063 Aug 02 11:01:59.849796 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User-Name: tempest-AttachVolumeShelveTestJSON-209900741-project Aug 02 11:01:59.849796 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: method: > Aug 02 11:01:59.849796 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: exception: Instance f86a8852-12b8-46d3-bd9b-bc140757b4c5 could not be found. Aug 02 11:01:59.849796 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: action_args: {'id': 'f86a8852-12b8-46d3-bd9b-bc140757b4c5'} Aug 02 11:01:59.850662 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 11:01:59.850662 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:01:59.850662 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 11:01:59.850662 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 11:01:59.850662 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 11:01:59.850662 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 11:01:59.850662 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 11:01:59.850662 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 11:01:59.850662 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 11:01:59.850662 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 11:01:59.850662 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f86a8852-12b8-46d3-bd9b-bc140757b4c5 could not be found. Aug 02 11:01:59.850662 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 11:01:59.850662 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 11:01:59.850662 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 11:01:59.850662 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:01:59.850662 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 11:01:59.850662 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 11:01:59.850662 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 11:01:59.850662 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 11:01:59.850662 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 11:01:59.852270 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 11:01:59.852270 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 11:01:59.852270 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 11:01:59.852270 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 11:01:59.852270 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 11:01:59.852270 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 11:01:59.852270 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 11:01:59.852270 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 11:01:59.852270 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 11:01:59.852270 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f86a8852-12b8-46d3-bd9b-bc140757b4c5 could not be found. Aug 02 11:01:59.852270 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 11:01:59.852270 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 11:01:59.852270 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 11:01:59.852270 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:01:59.852270 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 11:01:59.852270 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 11:01:59.852270 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 11:01:59.852270 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 11:01:59.852270 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f86a8852-12b8-46d3-bd9b-bc140757b4c5 could not be found. Aug 02 11:01:59.852270 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 11:01:59.853885 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-29eee85a-84bf-4409-b331-35284493a88b tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Returning 404 to user: Instance f86a8852-12b8-46d3-bd9b-bc140757b4c5 could not be found. {{(pid=129952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 11:01:59.854425 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-29eee85a-84bf-4409-b331-35284493a88b tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "DELETE /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5" status: 404 len: 111 microversion: 2.20 time: 0.038664 Aug 02 11:01:59.855766 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 437/889] 10.222.0.115 () {60 vars in 1285 bytes} [Tue Aug 2 11:01:59 2022] DELETE /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 02 11:01:59.867381 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-86bdd63a-cbf5-45aa-bc5d-e4b7158415c1 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:01:59.868089 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-86bdd63a-cbf5-45aa-bc5d-e4b7158415c1 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: f86a8852-12b8-46d3-bd9b-bc140757b4c5] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:01:59.875443 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-86bdd63a-cbf5-45aa-bc5d-e4b7158415c1 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:59.877292 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-86bdd63a-cbf5-45aa-bc5d-e4b7158415c1 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:59.878481 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-86bdd63a-cbf5-45aa-bc5d-e4b7158415c1 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:01:59.879580 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-86bdd63a-cbf5-45aa-bc5d-e4b7158415c1 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:01:59.905393 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.wsgi [None req-86bdd63a-cbf5-45aa-bc5d-e4b7158415c1 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] HTTP exception thrown: Instance f86a8852-12b8-46d3-bd9b-bc140757b4c5 could not be found. Aug 02 11:01:59.906894 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-86bdd63a-cbf5-45aa-bc5d-e4b7158415c1 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Request method failure captured: Aug 02 11:01:59.906894 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: request: GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5 HTTP/1.1 Aug 02 11:01:59.906894 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Accept: application/json Aug 02 11:01:59.906894 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Accept-Encoding: identity Aug 02 11:01:59.906894 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Connection: close Aug 02 11:01:59.906894 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Content-Length: 0 Aug 02 11:01:59.906894 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Content-Type: application/json Aug 02 11:01:59.906894 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Host: 10.222.0.115 Aug 02 11:01:59.906894 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Openstack-System-Scope: None Aug 02 11:01:59.906894 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: User-Agent: python-urllib3/1.26.10 Aug 02 11:01:59.906894 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Auth-Token: gAAAAABi6QKPaxrUk-Rq_Ctk1SOGwm4XuIXMS_HBTTUeAPSkZXFKcj0Lxt_OaInefAqehpe4qU3OoSMMi--ESVj5jZNszpAfca9aWIuGwsIwUCQbVLiuRiX4ryZJJc4W5WY1NNrTZ9QsvW57sxv55X9CXuxJOzOet8on3cbUt2Xg-0SGLE0ilJQ Aug 02 11:01:59.906894 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Domain-Id: None Aug 02 11:01:59.906894 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Domain-Name: None Aug 02 11:01:59.906894 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Identity-Status: Confirmed Aug 02 11:01:59.906894 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Is-Admin-Project: True Aug 02 11:01:59.906894 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Openstack-Nova-Api-Version: 2.20 Aug 02 11:01:59.906894 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Project-Domain-Id: default Aug 02 11:01:59.906894 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Project-Domain-Name: Default Aug 02 11:01:59.906894 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Project-Id: 1b3a294d5d02485980c82f065ee76bd7 Aug 02 11:01:59.906894 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-209900741 Aug 02 11:01:59.906894 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Role: reader,member Aug 02 11:01:59.906894 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Roles: reader,member Aug 02 11:01:59.908681 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/1b3a294d5d02485980c82f065ee76bd7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2/1b3a294d5d02485980c82f065ee76bd7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/1b3a294d5d02485980c82f065ee76bd7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.115:8080", "publicURL": "http://10.222.0.115:8080/v1/AUTH_1b3a294d5d02485980c82f065ee76bd7"}]}] Aug 02 11:01:59.908681 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Tenant: tempest-AttachVolumeShelveTestJSON-209900741 Aug 02 11:01:59.908681 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Tenant-Id: 1b3a294d5d02485980c82f065ee76bd7 Aug 02 11:01:59.908681 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-209900741 Aug 02 11:01:59.908681 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User: tempest-AttachVolumeShelveTestJSON-209900741-project Aug 02 11:01:59.908681 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User-Domain-Id: default Aug 02 11:01:59.908681 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User-Domain-Name: Default Aug 02 11:01:59.908681 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User-Id: ab1211acdd9a4df48c46f8807ed00063 Aug 02 11:01:59.908681 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User-Name: tempest-AttachVolumeShelveTestJSON-209900741-project Aug 02 11:01:59.908681 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: method: > Aug 02 11:01:59.908681 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: exception: Instance f86a8852-12b8-46d3-bd9b-bc140757b4c5 could not be found. Aug 02 11:01:59.908681 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: action_args: {'id': 'f86a8852-12b8-46d3-bd9b-bc140757b4c5'} Aug 02 11:01:59.909574 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 11:01:59.909574 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:01:59.909574 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 11:01:59.909574 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 11:01:59.909574 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 11:01:59.909574 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 11:01:59.909574 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 11:01:59.909574 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 11:01:59.909574 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 11:01:59.909574 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 11:01:59.909574 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f86a8852-12b8-46d3-bd9b-bc140757b4c5 could not be found. Aug 02 11:01:59.909574 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 11:01:59.909574 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 11:01:59.909574 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 11:01:59.909574 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:01:59.909574 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 11:01:59.909574 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 11:01:59.909574 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 11:01:59.909574 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 11:01:59.909574 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 11:01:59.911696 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 11:01:59.911696 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 11:01:59.911696 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 11:01:59.911696 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 11:01:59.911696 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 11:01:59.911696 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 11:01:59.911696 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 11:01:59.911696 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f86a8852-12b8-46d3-bd9b-bc140757b4c5 could not be found. Aug 02 11:01:59.911696 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 11:01:59.911696 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 11:01:59.911696 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 11:01:59.911696 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:01:59.911696 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 11:01:59.911696 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 11:01:59.911696 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 11:01:59.911696 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 11:01:59.911696 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f86a8852-12b8-46d3-bd9b-bc140757b4c5 could not be found. Aug 02 11:01:59.911696 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 11:01:59.913123 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-86bdd63a-cbf5-45aa-bc5d-e4b7158415c1 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Returning 404 to user: Instance f86a8852-12b8-46d3-bd9b-bc140757b4c5 could not be found. {{(pid=129953) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 11:01:59.913123 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-86bdd63a-cbf5-45aa-bc5d-e4b7158415c1 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5" status: 404 len: 111 microversion: 2.20 time: 0.050585 Aug 02 11:01:59.913123 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 453/890] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 11:01:59 2022] GET /compute/v2.1/servers/f86a8852-12b8-46d3-bd9b-bc140757b4c5 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 02 11:02:01.378963 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-0627e2c2-6315-46d9-944a-590abbba35f2 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:02:01.380013 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-0627e2c2-6315-46d9-944a-590abbba35f2 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: b3a92fc5-5c44-48d1-8394-535687bb6ae3] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:02:01.392963 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-0627e2c2-6315-46d9-944a-590abbba35f2 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:02:01.393449 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-0627e2c2-6315-46d9-944a-590abbba35f2 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:02:01.395737 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-0627e2c2-6315-46d9-944a-590abbba35f2 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:02:01.400841 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-0627e2c2-6315-46d9-944a-590abbba35f2 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:02:01.420409 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.wsgi [None req-0627e2c2-6315-46d9-944a-590abbba35f2 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] HTTP exception thrown: Instance b3a92fc5-5c44-48d1-8394-535687bb6ae3 could not be found. Aug 02 11:02:01.422237 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-0627e2c2-6315-46d9-944a-590abbba35f2 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Request method failure captured: Aug 02 11:02:01.422237 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: request: DELETE /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3 HTTP/1.1 Aug 02 11:02:01.422237 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Accept: application/json Aug 02 11:02:01.422237 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Accept-Encoding: identity Aug 02 11:02:01.422237 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Connection: close Aug 02 11:02:01.422237 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Content-Length: 0 Aug 02 11:02:01.422237 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Content-Type: application/json Aug 02 11:02:01.422237 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Host: 10.222.0.115 Aug 02 11:02:01.422237 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Openstack-System-Scope: None Aug 02 11:02:01.422237 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: User-Agent: python-urllib3/1.26.10 Aug 02 11:02:01.422237 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Auth-Token: gAAAAABi6QKPaxrUk-Rq_Ctk1SOGwm4XuIXMS_HBTTUeAPSkZXFKcj0Lxt_OaInefAqehpe4qU3OoSMMi--ESVj5jZNszpAfca9aWIuGwsIwUCQbVLiuRiX4ryZJJc4W5WY1NNrTZ9QsvW57sxv55X9CXuxJOzOet8on3cbUt2Xg-0SGLE0ilJQ Aug 02 11:02:01.422237 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Domain-Id: None Aug 02 11:02:01.422237 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Domain-Name: None Aug 02 11:02:01.422237 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Identity-Status: Confirmed Aug 02 11:02:01.422237 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Is-Admin-Project: True Aug 02 11:02:01.422237 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Openstack-Nova-Api-Version: 2.20 Aug 02 11:02:01.422237 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Project-Domain-Id: default Aug 02 11:02:01.422237 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Project-Domain-Name: Default Aug 02 11:02:01.422237 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Project-Id: 1b3a294d5d02485980c82f065ee76bd7 Aug 02 11:02:01.422237 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-209900741 Aug 02 11:02:01.422237 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Role: reader,member Aug 02 11:02:01.422237 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Roles: reader,member Aug 02 11:02:01.423986 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/1b3a294d5d02485980c82f065ee76bd7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2/1b3a294d5d02485980c82f065ee76bd7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/1b3a294d5d02485980c82f065ee76bd7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.115:8080", "publicURL": "http://10.222.0.115:8080/v1/AUTH_1b3a294d5d02485980c82f065ee76bd7"}]}] Aug 02 11:02:01.423986 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Tenant: tempest-AttachVolumeShelveTestJSON-209900741 Aug 02 11:02:01.423986 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Tenant-Id: 1b3a294d5d02485980c82f065ee76bd7 Aug 02 11:02:01.423986 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-209900741 Aug 02 11:02:01.423986 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User: tempest-AttachVolumeShelveTestJSON-209900741-project Aug 02 11:02:01.423986 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User-Domain-Id: default Aug 02 11:02:01.423986 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User-Domain-Name: Default Aug 02 11:02:01.423986 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User-Id: ab1211acdd9a4df48c46f8807ed00063 Aug 02 11:02:01.423986 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User-Name: tempest-AttachVolumeShelveTestJSON-209900741-project Aug 02 11:02:01.423986 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: method: > Aug 02 11:02:01.423986 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: exception: Instance b3a92fc5-5c44-48d1-8394-535687bb6ae3 could not be found. Aug 02 11:02:01.423986 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: action_args: {'id': 'b3a92fc5-5c44-48d1-8394-535687bb6ae3'} Aug 02 11:02:01.424890 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 11:02:01.424890 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:02:01.424890 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 11:02:01.424890 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 11:02:01.424890 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 11:02:01.424890 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 11:02:01.424890 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 11:02:01.424890 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 11:02:01.424890 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 11:02:01.424890 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 11:02:01.424890 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3a92fc5-5c44-48d1-8394-535687bb6ae3 could not be found. Aug 02 11:02:01.424890 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 11:02:01.424890 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 11:02:01.424890 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 11:02:01.424890 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:02:01.424890 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 11:02:01.424890 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 11:02:01.424890 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 11:02:01.424890 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 11:02:01.424890 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 11:02:01.426289 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 11:02:01.426289 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 11:02:01.426289 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 11:02:01.426289 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 11:02:01.426289 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 11:02:01.426289 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 11:02:01.426289 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 11:02:01.426289 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 11:02:01.426289 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 11:02:01.426289 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3a92fc5-5c44-48d1-8394-535687bb6ae3 could not be found. Aug 02 11:02:01.426289 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 11:02:01.426289 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 11:02:01.426289 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 11:02:01.426289 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:02:01.426289 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 11:02:01.426289 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 11:02:01.426289 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 11:02:01.426289 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 11:02:01.426289 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3a92fc5-5c44-48d1-8394-535687bb6ae3 could not be found. Aug 02 11:02:01.426289 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 11:02:01.427877 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-0627e2c2-6315-46d9-944a-590abbba35f2 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Returning 404 to user: Instance b3a92fc5-5c44-48d1-8394-535687bb6ae3 could not be found. {{(pid=129952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 11:02:01.427877 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-0627e2c2-6315-46d9-944a-590abbba35f2 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "DELETE /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3" status: 404 len: 111 microversion: 2.20 time: 0.050566 Aug 02 11:02:01.430999 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 438/891] 10.222.0.115 () {60 vars in 1285 bytes} [Tue Aug 2 11:02:01 2022] DELETE /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 02 11:02:01.439784 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-17caeb9d-b5b6-4d92-898b-17c8949d97b2 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:02:01.440526 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-17caeb9d-b5b6-4d92-898b-17c8949d97b2 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] [instance: b3a92fc5-5c44-48d1-8394-535687bb6ae3] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:02:01.452644 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-17caeb9d-b5b6-4d92-898b-17c8949d97b2 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:02:01.453379 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-17caeb9d-b5b6-4d92-898b-17c8949d97b2 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:02:01.454353 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-17caeb9d-b5b6-4d92-898b-17c8949d97b2 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:02:01.454953 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-17caeb9d-b5b6-4d92-898b-17c8949d97b2 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:02:01.472292 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.wsgi [None req-17caeb9d-b5b6-4d92-898b-17c8949d97b2 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] HTTP exception thrown: Instance b3a92fc5-5c44-48d1-8394-535687bb6ae3 could not be found. Aug 02 11:02:01.474374 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-17caeb9d-b5b6-4d92-898b-17c8949d97b2 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Request method failure captured: Aug 02 11:02:01.474374 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: request: GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3 HTTP/1.1 Aug 02 11:02:01.474374 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Accept: application/json Aug 02 11:02:01.474374 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Accept-Encoding: identity Aug 02 11:02:01.474374 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Connection: close Aug 02 11:02:01.474374 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Content-Length: 0 Aug 02 11:02:01.474374 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Content-Type: application/json Aug 02 11:02:01.474374 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Host: 10.222.0.115 Aug 02 11:02:01.474374 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Openstack-System-Scope: None Aug 02 11:02:01.474374 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: User-Agent: python-urllib3/1.26.10 Aug 02 11:02:01.474374 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Auth-Token: gAAAAABi6QKPaxrUk-Rq_Ctk1SOGwm4XuIXMS_HBTTUeAPSkZXFKcj0Lxt_OaInefAqehpe4qU3OoSMMi--ESVj5jZNszpAfca9aWIuGwsIwUCQbVLiuRiX4ryZJJc4W5WY1NNrTZ9QsvW57sxv55X9CXuxJOzOet8on3cbUt2Xg-0SGLE0ilJQ Aug 02 11:02:01.474374 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Domain-Id: None Aug 02 11:02:01.474374 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Domain-Name: None Aug 02 11:02:01.474374 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Identity-Status: Confirmed Aug 02 11:02:01.474374 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Is-Admin-Project: True Aug 02 11:02:01.474374 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Openstack-Nova-Api-Version: 2.20 Aug 02 11:02:01.474374 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Project-Domain-Id: default Aug 02 11:02:01.474374 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Project-Domain-Name: Default Aug 02 11:02:01.474374 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Project-Id: 1b3a294d5d02485980c82f065ee76bd7 Aug 02 11:02:01.474374 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-209900741 Aug 02 11:02:01.474374 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Role: reader,member Aug 02 11:02:01.474374 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Roles: reader,member Aug 02 11:02:01.486282 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/1b3a294d5d02485980c82f065ee76bd7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2/1b3a294d5d02485980c82f065ee76bd7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/1b3a294d5d02485980c82f065ee76bd7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.115:8080", "publicURL": "http://10.222.0.115:8080/v1/AUTH_1b3a294d5d02485980c82f065ee76bd7"}]}] Aug 02 11:02:01.486282 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Tenant: tempest-AttachVolumeShelveTestJSON-209900741 Aug 02 11:02:01.486282 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Tenant-Id: 1b3a294d5d02485980c82f065ee76bd7 Aug 02 11:02:01.486282 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-209900741 Aug 02 11:02:01.486282 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User: tempest-AttachVolumeShelveTestJSON-209900741-project Aug 02 11:02:01.486282 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User-Domain-Id: default Aug 02 11:02:01.486282 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User-Domain-Name: Default Aug 02 11:02:01.486282 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User-Id: ab1211acdd9a4df48c46f8807ed00063 Aug 02 11:02:01.486282 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User-Name: tempest-AttachVolumeShelveTestJSON-209900741-project Aug 02 11:02:01.486282 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: method: > Aug 02 11:02:01.486282 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: exception: Instance b3a92fc5-5c44-48d1-8394-535687bb6ae3 could not be found. Aug 02 11:02:01.486282 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: action_args: {'id': 'b3a92fc5-5c44-48d1-8394-535687bb6ae3'} Aug 02 11:02:01.487605 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 11:02:01.487605 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:02:01.487605 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 11:02:01.487605 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 11:02:01.487605 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 11:02:01.487605 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 11:02:01.487605 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 11:02:01.487605 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 11:02:01.487605 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 11:02:01.487605 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 11:02:01.487605 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3a92fc5-5c44-48d1-8394-535687bb6ae3 could not be found. Aug 02 11:02:01.487605 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 11:02:01.487605 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 11:02:01.487605 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 11:02:01.487605 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:02:01.487605 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 11:02:01.487605 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 11:02:01.487605 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 11:02:01.487605 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 11:02:01.487605 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 11:02:01.488927 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 11:02:01.488927 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 11:02:01.488927 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 11:02:01.488927 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 11:02:01.488927 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 11:02:01.488927 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 11:02:01.488927 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 11:02:01.488927 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3a92fc5-5c44-48d1-8394-535687bb6ae3 could not be found. Aug 02 11:02:01.488927 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 11:02:01.488927 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 11:02:01.488927 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 11:02:01.488927 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:02:01.488927 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 11:02:01.488927 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 11:02:01.488927 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 11:02:01.488927 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 11:02:01.488927 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3a92fc5-5c44-48d1-8394-535687bb6ae3 could not be found. Aug 02 11:02:01.488927 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 11:02:01.490043 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-17caeb9d-b5b6-4d92-898b-17c8949d97b2 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] Returning 404 to user: Instance b3a92fc5-5c44-48d1-8394-535687bb6ae3 could not be found. {{(pid=129953) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 11:02:01.490043 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-17caeb9d-b5b6-4d92-898b-17c8949d97b2 tempest-AttachVolumeShelveTestJSON-209900741 tempest-AttachVolumeShelveTestJSON-209900741-project] 10.222.0.115 "GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3" status: 404 len: 111 microversion: 2.20 time: 0.044378 Aug 02 11:02:01.490043 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 454/892] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Aug 2 11:02:01 2022] GET /compute/v2.1/servers/b3a92fc5-5c44-48d1-8394-535687bb6ae3 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 02 11:02:40.876724 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-55a00a77-fc66-4335-8b26-5916e280ec21 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1007381586", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1578588330", "security_groups": [{"name": "tempest-secgroup-smoke-1142860438"}], "block_device_mapping_v2": [{"uuid": "0523a599-809a-45a6-82b6-27b3e4652fa1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "45890e76-360d-451b-af94-f2be74c19cda"}]}} {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 11:02:40.887278 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG dbcounter [-] [129952] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=129952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 11:02:40.888081 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG dbcounter [-] [129952] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=24 {{(pid=129952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 11:02:41.000593 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.network.neutron [None req-55a00a77-fc66-4335-8b26-5916e280ec21 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] validate_networks() for [('45890e76-360d-451b-af94-f2be74c19cda', None, None, None, None, None)] {{(pid=129952) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 11:02:41.426178 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.virt.hardware [None req-55a00a77-fc66-4335-8b26-5916e280ec21 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Flavor limits 0:0:0 {{(pid=129952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 11:02:41.426607 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.virt.hardware [None req-55a00a77-fc66-4335-8b26-5916e280ec21 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Image limits 0:0:0 {{(pid=129952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 11:02:41.427100 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.virt.hardware [None req-55a00a77-fc66-4335-8b26-5916e280ec21 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Flavor pref 0:0:0 {{(pid=129952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 11:02:41.428043 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.virt.hardware [None req-55a00a77-fc66-4335-8b26-5916e280ec21 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Image pref 0:0:0 {{(pid=129952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 11:02:41.428732 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.virt.hardware [None req-55a00a77-fc66-4335-8b26-5916e280ec21 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 11:02:41.440293 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-55a00a77-fc66-4335-8b26-5916e280ec21 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:02:41.441887 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-55a00a77-fc66-4335-8b26-5916e280ec21 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:02:41.444978 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-55a00a77-fc66-4335-8b26-5916e280ec21 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:02:41.444978 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-55a00a77-fc66-4335-8b26-5916e280ec21 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:02:41.466765 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.quota [None req-55a00a77-fc66-4335-8b26-5916e280ec21 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Getting quotas for project be66234794284419a47e3afcae968084. Resources: {'instances', 'cores', 'ram'} {{(pid=129952) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 11:02:41.470846 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.quota [None req-55a00a77-fc66-4335-8b26-5916e280ec21 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Getting quotas for user 914de37664914b4cb91e0ce2c3a0e1d1 and project be66234794284419a47e3afcae968084. Resources: {'instances', 'cores', 'ram'} {{(pid=129952) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 11:02:41.634651 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-55a00a77-fc66-4335-8b26-5916e280ec21 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Going to run 1 instances... {{(pid=129952) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 11:02:41.637181 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-55a00a77-fc66-4335-8b26-5916e280ec21 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] [instance: fd09d54f-4850-44ab-b2e8-f58a339680b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0523a599-809a-45a6-82b6-27b3e4652fa1',volume_size=None,volume_type=None)] {{(pid=129952) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 11:02:42.529965 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-55a00a77-fc66-4335-8b26-5916e280ec21 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] 10.222.0.115 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.657248 Aug 02 11:02:42.530959 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 439/893] 10.222.0.115 () {60 vars in 1152 bytes} [Tue Aug 2 11:02:40 2022] POST /compute/v2.1/servers => generated 408 bytes in 1659 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 02 11:02:42.541919 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-b5402c22-5d7c-4866-9a63-9ce33d8a7d6c tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:02:42.543131 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-b5402c22-5d7c-4866-9a63-9ce33d8a7d6c tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] [instance: fd09d54f-4850-44ab-b2e8-f58a339680b1] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:02:42.545933 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG dbcounter [-] [129953] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=129953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 11:02:42.546593 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG dbcounter [-] [129953] Writing DB stats nova_cell1:SELECT=18 {{(pid=129953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 11:02:42.603642 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-b5402c22-5d7c-4866-9a63-9ce33d8a7d6c tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914de37664914b4cb91e0ce2c3a0e1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66234794284419a47e3afcae968084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:02:42.610854 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-b5402c22-5d7c-4866-9a63-9ce33d8a7d6c tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] 10.222.0.115 "GET /compute/v2.1/servers/fd09d54f-4850-44ab-b2e8-f58a339680b1" status: 200 len: 1098 microversion: 2.1 time: 0.072422 Aug 02 11:02:42.615245 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 455/894] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:02:42 2022] GET /compute/v2.1/servers/fd09d54f-4850-44ab-b2e8-f58a339680b1 => generated 1098 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:02:43.631543 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-65b70c11-0c55-4b26-9e28-3c8041ab2dec tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:02:43.632162 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-65b70c11-0c55-4b26-9e28-3c8041ab2dec tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] [instance: fd09d54f-4850-44ab-b2e8-f58a339680b1] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:02:43.638354 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-65b70c11-0c55-4b26-9e28-3c8041ab2dec tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:02:43.638809 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-65b70c11-0c55-4b26-9e28-3c8041ab2dec tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:02:43.639610 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-65b70c11-0c55-4b26-9e28-3c8041ab2dec tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:02:43.640053 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-65b70c11-0c55-4b26-9e28-3c8041ab2dec tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:02:43.701807 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-65b70c11-0c55-4b26-9e28-3c8041ab2dec tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914de37664914b4cb91e0ce2c3a0e1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66234794284419a47e3afcae968084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:02:43.710483 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-65b70c11-0c55-4b26-9e28-3c8041ab2dec tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] 10.222.0.115 "GET /compute/v2.1/servers/fd09d54f-4850-44ab-b2e8-f58a339680b1" status: 200 len: 1148 microversion: 2.1 time: 0.083424 Aug 02 11:02:43.710978 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 440/895] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:02:43 2022] GET /compute/v2.1/servers/fd09d54f-4850-44ab-b2e8-f58a339680b1 => generated 1148 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:02:44.732275 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-58e43241-1002-488d-af5c-661f5f5da148 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:02:44.732888 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-58e43241-1002-488d-af5c-661f5f5da148 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] [instance: fd09d54f-4850-44ab-b2e8-f58a339680b1] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:02:44.740730 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-58e43241-1002-488d-af5c-661f5f5da148 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:02:44.741158 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-58e43241-1002-488d-af5c-661f5f5da148 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:02:44.741934 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-58e43241-1002-488d-af5c-661f5f5da148 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:02:44.742373 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-58e43241-1002-488d-af5c-661f5f5da148 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:02:44.808945 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-58e43241-1002-488d-af5c-661f5f5da148 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914de37664914b4cb91e0ce2c3a0e1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66234794284419a47e3afcae968084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:02:44.816539 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-58e43241-1002-488d-af5c-661f5f5da148 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] 10.222.0.115 "GET /compute/v2.1/servers/fd09d54f-4850-44ab-b2e8-f58a339680b1" status: 200 len: 1148 microversion: 2.1 time: 0.088797 Aug 02 11:02:44.817090 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 456/896] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:02:44 2022] GET /compute/v2.1/servers/fd09d54f-4850-44ab-b2e8-f58a339680b1 => generated 1148 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:02:45.837496 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-6976c6ca-72dd-412e-bde9-d457f9f7fb3c tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:02:45.838107 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-6976c6ca-72dd-412e-bde9-d457f9f7fb3c tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] [instance: fd09d54f-4850-44ab-b2e8-f58a339680b1] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:02:45.845269 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-6976c6ca-72dd-412e-bde9-d457f9f7fb3c tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:02:45.845724 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-6976c6ca-72dd-412e-bde9-d457f9f7fb3c tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:02:45.846512 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-6976c6ca-72dd-412e-bde9-d457f9f7fb3c tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:02:45.846987 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-6976c6ca-72dd-412e-bde9-d457f9f7fb3c tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:02:45.934931 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-6976c6ca-72dd-412e-bde9-d457f9f7fb3c tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914de37664914b4cb91e0ce2c3a0e1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66234794284419a47e3afcae968084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:02:45.943457 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-6976c6ca-72dd-412e-bde9-d457f9f7fb3c tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] 10.222.0.115 "GET /compute/v2.1/servers/fd09d54f-4850-44ab-b2e8-f58a339680b1" status: 200 len: 1204 microversion: 2.1 time: 0.109757 Aug 02 11:02:45.944034 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 441/897] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:02:45 2022] GET /compute/v2.1/servers/fd09d54f-4850-44ab-b2e8-f58a339680b1 => generated 1204 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:02:46.966793 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-540f62b2-4cb8-4296-bdc5-d0ca45279a91 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:02:46.968171 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-540f62b2-4cb8-4296-bdc5-d0ca45279a91 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] [instance: fd09d54f-4850-44ab-b2e8-f58a339680b1] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:02:46.975386 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-540f62b2-4cb8-4296-bdc5-d0ca45279a91 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:02:46.975838 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-540f62b2-4cb8-4296-bdc5-d0ca45279a91 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:02:46.976615 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-540f62b2-4cb8-4296-bdc5-d0ca45279a91 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:02:46.977501 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-540f62b2-4cb8-4296-bdc5-d0ca45279a91 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:02:47.203310 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-540f62b2-4cb8-4296-bdc5-d0ca45279a91 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914de37664914b4cb91e0ce2c3a0e1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66234794284419a47e3afcae968084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:02:47.214869 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-540f62b2-4cb8-4296-bdc5-d0ca45279a91 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] 10.222.0.115 "GET /compute/v2.1/servers/fd09d54f-4850-44ab-b2e8-f58a339680b1" status: 200 len: 1282 microversion: 2.1 time: 0.250346 Aug 02 11:02:47.214869 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 457/898] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:02:46 2022] GET /compute/v2.1/servers/fd09d54f-4850-44ab-b2e8-f58a339680b1 => generated 1282 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:02:47.984071 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [req-7db7a203-c12f-4e3e-b5f9-cee9956f6be7 req-6e157806-2c39-4ec4-b8c2-a8a08873d96f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd09d54f-4850-44ab-b2e8-f58a339680b1", "tag": "0152f1cc-99ed-464f-a9fb-213142a00fb8"}]} {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 11:02:48.005573 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [req-7db7a203-c12f-4e3e-b5f9-cee9956f6be7 req-6e157806-2c39-4ec4-b8c2-a8a08873d96f service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:02:48.006081 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [req-7db7a203-c12f-4e3e-b5f9-cee9956f6be7 req-6e157806-2c39-4ec4-b8c2-a8a08873d96f service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:02:48.025541 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.compute.server_external_events [req-7db7a203-c12f-4e3e-b5f9-cee9956f6be7 req-6e157806-2c39-4ec4-b8c2-a8a08873d96f service nova] Creating event network-changed:0152f1cc-99ed-464f-a9fb-213142a00fb8 for instance fd09d54f-4850-44ab-b2e8-f58a339680b1 on hv-cinder-85031 Aug 02 11:02:48.034775 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [req-7db7a203-c12f-4e3e-b5f9-cee9956f6be7 req-6e157806-2c39-4ec4-b8c2-a8a08873d96f service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054167 Aug 02 11:02:48.035828 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 442/899] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Aug 2 11:02:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 11:02:48.246639 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-2539ea51-edda-40e7-83a9-b40826516c32 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:02:48.248973 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-2539ea51-edda-40e7-83a9-b40826516c32 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] [instance: fd09d54f-4850-44ab-b2e8-f58a339680b1] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:02:48.260609 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-2539ea51-edda-40e7-83a9-b40826516c32 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:02:48.261366 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-2539ea51-edda-40e7-83a9-b40826516c32 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:02:48.262348 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-2539ea51-edda-40e7-83a9-b40826516c32 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:02:48.263174 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-2539ea51-edda-40e7-83a9-b40826516c32 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:02:48.483480 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-2539ea51-edda-40e7-83a9-b40826516c32 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914de37664914b4cb91e0ce2c3a0e1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66234794284419a47e3afcae968084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:02:48.493168 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-2539ea51-edda-40e7-83a9-b40826516c32 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] 10.222.0.115 "GET /compute/v2.1/servers/fd09d54f-4850-44ab-b2e8-f58a339680b1" status: 200 len: 1270 microversion: 2.1 time: 0.253649 Aug 02 11:02:48.494013 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 458/900] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:02:48 2022] GET /compute/v2.1/servers/fd09d54f-4850-44ab-b2e8-f58a339680b1 => generated 1270 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:02:49.519325 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-26b4232d-e0e7-4a1e-bef1-5f26361a9513 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:02:49.520909 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-26b4232d-e0e7-4a1e-bef1-5f26361a9513 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] [instance: fd09d54f-4850-44ab-b2e8-f58a339680b1] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:02:49.533591 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-26b4232d-e0e7-4a1e-bef1-5f26361a9513 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:02:49.534575 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-26b4232d-e0e7-4a1e-bef1-5f26361a9513 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:02:49.535630 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-26b4232d-e0e7-4a1e-bef1-5f26361a9513 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:02:49.536200 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-26b4232d-e0e7-4a1e-bef1-5f26361a9513 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:02:49.725326 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-26b4232d-e0e7-4a1e-bef1-5f26361a9513 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914de37664914b4cb91e0ce2c3a0e1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66234794284419a47e3afcae968084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:02:49.733283 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-26b4232d-e0e7-4a1e-bef1-5f26361a9513 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] 10.222.0.115 "GET /compute/v2.1/servers/fd09d54f-4850-44ab-b2e8-f58a339680b1" status: 200 len: 1270 microversion: 2.1 time: 0.219430 Aug 02 11:02:49.733955 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 443/901] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:02:49 2022] GET /compute/v2.1/servers/fd09d54f-4850-44ab-b2e8-f58a339680b1 => generated 1270 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:02:50.754702 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-38b4fff8-4074-436c-a7c2-09dd707894ac tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:02:50.755342 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-38b4fff8-4074-436c-a7c2-09dd707894ac tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] [instance: fd09d54f-4850-44ab-b2e8-f58a339680b1] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:02:50.761874 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-38b4fff8-4074-436c-a7c2-09dd707894ac tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:02:50.762309 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-38b4fff8-4074-436c-a7c2-09dd707894ac tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:02:50.763087 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-38b4fff8-4074-436c-a7c2-09dd707894ac tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:02:50.763510 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-38b4fff8-4074-436c-a7c2-09dd707894ac tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:02:50.913378 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-38b4fff8-4074-436c-a7c2-09dd707894ac tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914de37664914b4cb91e0ce2c3a0e1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66234794284419a47e3afcae968084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:02:50.921494 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-38b4fff8-4074-436c-a7c2-09dd707894ac tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] 10.222.0.115 "GET /compute/v2.1/servers/fd09d54f-4850-44ab-b2e8-f58a339680b1" status: 200 len: 1270 microversion: 2.1 time: 0.170498 Aug 02 11:02:50.922349 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 459/902] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:02:50 2022] GET /compute/v2.1/servers/fd09d54f-4850-44ab-b2e8-f58a339680b1 => generated 1270 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:02:51.945943 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-af15aeb3-96be-4e09-948d-9238db9babe3 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:02:51.947784 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-af15aeb3-96be-4e09-948d-9238db9babe3 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] [instance: fd09d54f-4850-44ab-b2e8-f58a339680b1] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:02:51.962794 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG dbcounter [-] [129952] Writing DB stats nova_cell0:SELECT=2 {{(pid=129952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 11:02:51.963546 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG dbcounter [-] [129952] Writing DB stats nova_cell0:SELECT=6 {{(pid=129952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 11:02:51.976545 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-af15aeb3-96be-4e09-948d-9238db9babe3 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:02:51.977001 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-af15aeb3-96be-4e09-948d-9238db9babe3 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:02:51.977793 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-af15aeb3-96be-4e09-948d-9238db9babe3 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:02:51.985396 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-af15aeb3-96be-4e09-948d-9238db9babe3 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:02:52.213430 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-af15aeb3-96be-4e09-948d-9238db9babe3 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914de37664914b4cb91e0ce2c3a0e1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66234794284419a47e3afcae968084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:02:52.225049 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-af15aeb3-96be-4e09-948d-9238db9babe3 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] 10.222.0.115 "GET /compute/v2.1/servers/fd09d54f-4850-44ab-b2e8-f58a339680b1" status: 200 len: 1270 microversion: 2.1 time: 0.285001 Aug 02 11:02:52.233958 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 444/903] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:02:51 2022] GET /compute/v2.1/servers/fd09d54f-4850-44ab-b2e8-f58a339680b1 => generated 1270 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:02:53.254621 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-51b919b8-d8ac-4330-9a55-fba7371739e2 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:02:53.257238 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-51b919b8-d8ac-4330-9a55-fba7371739e2 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] [instance: fd09d54f-4850-44ab-b2e8-f58a339680b1] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:02:53.257592 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG dbcounter [-] [129953] Writing DB stats nova_cell0:SELECT=2 {{(pid=129953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 11:02:53.262424 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-51b919b8-d8ac-4330-9a55-fba7371739e2 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:02:53.262920 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-51b919b8-d8ac-4330-9a55-fba7371739e2 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:02:53.263710 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-51b919b8-d8ac-4330-9a55-fba7371739e2 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:02:53.264142 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-51b919b8-d8ac-4330-9a55-fba7371739e2 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:02:53.417589 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-51b919b8-d8ac-4330-9a55-fba7371739e2 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914de37664914b4cb91e0ce2c3a0e1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66234794284419a47e3afcae968084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:02:53.425243 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-51b919b8-d8ac-4330-9a55-fba7371739e2 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] 10.222.0.115 "GET /compute/v2.1/servers/fd09d54f-4850-44ab-b2e8-f58a339680b1" status: 200 len: 1270 microversion: 2.1 time: 0.175277 Aug 02 11:02:53.426445 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 460/904] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:02:53 2022] GET /compute/v2.1/servers/fd09d54f-4850-44ab-b2e8-f58a339680b1 => generated 1270 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:02:54.447787 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-5789c097-a25a-4e67-bdaf-ab437b713509 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:02:54.448386 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-5789c097-a25a-4e67-bdaf-ab437b713509 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] [instance: fd09d54f-4850-44ab-b2e8-f58a339680b1] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:02:54.455910 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-5789c097-a25a-4e67-bdaf-ab437b713509 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:02:54.456363 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-5789c097-a25a-4e67-bdaf-ab437b713509 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:02:54.457124 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-5789c097-a25a-4e67-bdaf-ab437b713509 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:02:54.457584 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-5789c097-a25a-4e67-bdaf-ab437b713509 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:02:54.590805 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-5789c097-a25a-4e67-bdaf-ab437b713509 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914de37664914b4cb91e0ce2c3a0e1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66234794284419a47e3afcae968084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:02:54.599034 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-5789c097-a25a-4e67-bdaf-ab437b713509 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] 10.222.0.115 "GET /compute/v2.1/servers/fd09d54f-4850-44ab-b2e8-f58a339680b1" status: 200 len: 1270 microversion: 2.1 time: 0.155169 Aug 02 11:02:54.599755 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 445/905] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:02:54 2022] GET /compute/v2.1/servers/fd09d54f-4850-44ab-b2e8-f58a339680b1 => generated 1270 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:02:55.620336 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-34a03cca-656b-40cc-90af-71e08b545db6 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:02:55.620940 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-34a03cca-656b-40cc-90af-71e08b545db6 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] [instance: fd09d54f-4850-44ab-b2e8-f58a339680b1] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:02:55.627468 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-34a03cca-656b-40cc-90af-71e08b545db6 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:02:55.627908 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-34a03cca-656b-40cc-90af-71e08b545db6 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:02:55.628698 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-34a03cca-656b-40cc-90af-71e08b545db6 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:02:55.629879 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-34a03cca-656b-40cc-90af-71e08b545db6 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:02:55.763739 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-34a03cca-656b-40cc-90af-71e08b545db6 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914de37664914b4cb91e0ce2c3a0e1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66234794284419a47e3afcae968084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:02:55.771334 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-34a03cca-656b-40cc-90af-71e08b545db6 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] 10.222.0.115 "GET /compute/v2.1/servers/fd09d54f-4850-44ab-b2e8-f58a339680b1" status: 200 len: 1270 microversion: 2.1 time: 0.154910 Aug 02 11:02:55.771900 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 461/906] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:02:55 2022] GET /compute/v2.1/servers/fd09d54f-4850-44ab-b2e8-f58a339680b1 => generated 1270 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:02:56.792689 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-1a0435a2-c4f3-4ab2-ab5b-5c7a7408fcc6 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:02:56.793284 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-1a0435a2-c4f3-4ab2-ab5b-5c7a7408fcc6 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] [instance: fd09d54f-4850-44ab-b2e8-f58a339680b1] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:02:56.799790 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-1a0435a2-c4f3-4ab2-ab5b-5c7a7408fcc6 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:02:56.800237 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-1a0435a2-c4f3-4ab2-ab5b-5c7a7408fcc6 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:02:56.801089 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-1a0435a2-c4f3-4ab2-ab5b-5c7a7408fcc6 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:02:56.801461 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-1a0435a2-c4f3-4ab2-ab5b-5c7a7408fcc6 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:02:56.973702 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-1a0435a2-c4f3-4ab2-ab5b-5c7a7408fcc6 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914de37664914b4cb91e0ce2c3a0e1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66234794284419a47e3afcae968084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:02:56.973702 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-1a0435a2-c4f3-4ab2-ab5b-5c7a7408fcc6 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] 10.222.0.115 "GET /compute/v2.1/servers/fd09d54f-4850-44ab-b2e8-f58a339680b1" status: 200 len: 1270 microversion: 2.1 time: 0.183671 Aug 02 11:02:56.973702 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 446/907] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:02:56 2022] GET /compute/v2.1/servers/fd09d54f-4850-44ab-b2e8-f58a339680b1 => generated 1270 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:02:57.436735 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-d1291814-ad4a-4406-8772-92f9b1a0d5b7 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-312899732", "imageRef": "aa0a7b8c-0dd6-4803-8767-cb8c2d05fdd4", "flavorRef": "452", "networks": [{"uuid": "5c059d2f-797d-44ba-a7f6-798dc62d3140"}]}} {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 11:02:57.492277 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.network.neutron [None req-d1291814-ad4a-4406-8772-92f9b1a0d5b7 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] validate_networks() for [('5c059d2f-797d-44ba-a7f6-798dc62d3140', None, None, None, None, None)] {{(pid=129953) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 11:02:57.958541 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.virt.hardware [None req-d1291814-ad4a-4406-8772-92f9b1a0d5b7 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Flavor limits 0:0:0 {{(pid=129953) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 11:02:57.958976 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.virt.hardware [None req-d1291814-ad4a-4406-8772-92f9b1a0d5b7 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Image limits 0:0:0 {{(pid=129953) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 11:02:57.959478 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.virt.hardware [None req-d1291814-ad4a-4406-8772-92f9b1a0d5b7 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Flavor pref 0:0:0 {{(pid=129953) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 11:02:57.959891 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.virt.hardware [None req-d1291814-ad4a-4406-8772-92f9b1a0d5b7 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Image pref 0:0:0 {{(pid=129953) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 11:02:57.960305 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.virt.hardware [None req-d1291814-ad4a-4406-8772-92f9b1a0d5b7 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129953) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 11:02:57.969385 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-d1291814-ad4a-4406-8772-92f9b1a0d5b7 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:02:57.969832 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-d1291814-ad4a-4406-8772-92f9b1a0d5b7 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:02:57.970623 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-d1291814-ad4a-4406-8772-92f9b1a0d5b7 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:02:57.971171 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-d1291814-ad4a-4406-8772-92f9b1a0d5b7 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:02:57.988464 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.quota [None req-d1291814-ad4a-4406-8772-92f9b1a0d5b7 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Getting quotas for project 4dccda1fb9a44c3d91811677bd6f36c3. Resources: {'instances', 'cores', 'ram'} {{(pid=129953) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 11:02:57.992613 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.quota [None req-d1291814-ad4a-4406-8772-92f9b1a0d5b7 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Getting quotas for user d4ba1b5dac82438391a56b7cda25a363 and project 4dccda1fb9a44c3d91811677bd6f36c3. Resources: {'instances', 'cores', 'ram'} {{(pid=129953) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 11:02:57.994818 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-9fe876a3-0225-4add-b23b-a94581dbd332 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:02:57.994818 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-9fe876a3-0225-4add-b23b-a94581dbd332 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] [instance: fd09d54f-4850-44ab-b2e8-f58a339680b1] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:02:58.001408 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-9fe876a3-0225-4add-b23b-a94581dbd332 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:02:58.001861 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-9fe876a3-0225-4add-b23b-a94581dbd332 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:02:58.002632 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-9fe876a3-0225-4add-b23b-a94581dbd332 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:02:58.003263 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-9fe876a3-0225-4add-b23b-a94581dbd332 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:02:58.004358 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-d1291814-ad4a-4406-8772-92f9b1a0d5b7 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Going to run 1 instances... {{(pid=129953) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 11:02:58.009119 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-d1291814-ad4a-4406-8772-92f9b1a0d5b7 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] [instance: 1ec98e47-e93b-4a79-ad3d-78e2dd1aa22a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aa0a7b8c-0dd6-4803-8767-cb8c2d05fdd4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129953) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 11:02:58.145733 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-9fe876a3-0225-4add-b23b-a94581dbd332 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914de37664914b4cb91e0ce2c3a0e1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66234794284419a47e3afcae968084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:02:58.153616 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-9fe876a3-0225-4add-b23b-a94581dbd332 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] 10.222.0.115 "GET /compute/v2.1/servers/fd09d54f-4850-44ab-b2e8-f58a339680b1" status: 200 len: 1270 microversion: 2.1 time: 0.163476 Aug 02 11:02:58.154172 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 447/908] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:02:57 2022] GET /compute/v2.1/servers/fd09d54f-4850-44ab-b2e8-f58a339680b1 => generated 1270 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:02:58.204197 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-d1291814-ad4a-4406-8772-92f9b1a0d5b7 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] 10.222.0.115 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.771321 Aug 02 11:02:58.204911 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 462/909] 10.222.0.115 () {60 vars in 1152 bytes} [Tue Aug 2 11:02:57 2022] POST /compute/v2.1/servers => generated 382 bytes in 773 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 02 11:02:58.217329 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-1c98cb07-3895-4af6-831b-75aa68191d69 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:02:58.217942 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-1c98cb07-3895-4af6-831b-75aa68191d69 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] [instance: 1ec98e47-e93b-4a79-ad3d-78e2dd1aa22a] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:02:58.274298 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-1c98cb07-3895-4af6-831b-75aa68191d69 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ba1b5dac82438391a56b7cda25a363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dccda1fb9a44c3d91811677bd6f36c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:02:58.281098 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-1c98cb07-3895-4af6-831b-75aa68191d69 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] 10.222.0.115 "GET /compute/v2.1/servers/1ec98e47-e93b-4a79-ad3d-78e2dd1aa22a" status: 200 len: 1217 microversion: 2.1 time: 0.068052 Aug 02 11:02:58.281671 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 448/910] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:02:58 2022] GET /compute/v2.1/servers/1ec98e47-e93b-4a79-ad3d-78e2dd1aa22a => generated 1217 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:02:59.173261 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-75a447d8-c571-486c-a26a-a18e11bc4389 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:02:59.175021 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-75a447d8-c571-486c-a26a-a18e11bc4389 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] [instance: 254a6894-dcb1-4909-a24e-a3a9bf701a83] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:02:59.177473 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-5deee8a9-87f6-4cd1-9dba-32166e07431b tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:02:59.178394 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-5deee8a9-87f6-4cd1-9dba-32166e07431b tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] [instance: fd09d54f-4850-44ab-b2e8-f58a339680b1] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:02:59.187077 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-75a447d8-c571-486c-a26a-a18e11bc4389 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:02:59.187969 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-75a447d8-c571-486c-a26a-a18e11bc4389 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:02:59.189087 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-75a447d8-c571-486c-a26a-a18e11bc4389 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:02:59.189889 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-75a447d8-c571-486c-a26a-a18e11bc4389 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:02:59.192706 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-5deee8a9-87f6-4cd1-9dba-32166e07431b tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:02:59.194527 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-5deee8a9-87f6-4cd1-9dba-32166e07431b tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:02:59.195540 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-5deee8a9-87f6-4cd1-9dba-32166e07431b tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:02:59.197271 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-5deee8a9-87f6-4cd1-9dba-32166e07431b tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:02:59.221667 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-75a447d8-c571-486c-a26a-a18e11bc4389 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] [instance: 254a6894-dcb1-4909-a24e-a3a9bf701a83] Going to try to terminate instance {{(pid=129953) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 11:02:59.396204 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-5deee8a9-87f6-4cd1-9dba-32166e07431b tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914de37664914b4cb91e0ce2c3a0e1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66234794284419a47e3afcae968084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:02:59.405578 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-5deee8a9-87f6-4cd1-9dba-32166e07431b tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] 10.222.0.115 "GET /compute/v2.1/servers/fd09d54f-4850-44ab-b2e8-f58a339680b1" status: 200 len: 1270 microversion: 2.1 time: 0.234311 Aug 02 11:02:59.406162 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 449/911] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:02:59 2022] GET /compute/v2.1/servers/fd09d54f-4850-44ab-b2e8-f58a339680b1 => generated 1270 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:02:59.413455 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [req-8a7cc1d0-5e22-4d1b-97fa-841a9ee6b20e req-98bc8d39-a136-4001-99cb-9e7e430bad06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "254a6894-dcb1-4909-a24e-a3a9bf701a83", "tag": "950f72fe-d9c4-4546-b649-bf02fe995cd8"}]} {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 11:02:59.424739 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [req-8a7cc1d0-5e22-4d1b-97fa-841a9ee6b20e req-98bc8d39-a136-4001-99cb-9e7e430bad06 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:02:59.426013 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [req-8a7cc1d0-5e22-4d1b-97fa-841a9ee6b20e req-98bc8d39-a136-4001-99cb-9e7e430bad06 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:02:59.438985 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.compute.server_external_events [req-8a7cc1d0-5e22-4d1b-97fa-841a9ee6b20e req-98bc8d39-a136-4001-99cb-9e7e430bad06 service nova] Creating event network-changed:950f72fe-d9c4-4546-b649-bf02fe995cd8 for instance 254a6894-dcb1-4909-a24e-a3a9bf701a83 on hv-cinder-85031 Aug 02 11:02:59.445973 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [req-8a7cc1d0-5e22-4d1b-97fa-841a9ee6b20e req-98bc8d39-a136-4001-99cb-9e7e430bad06 service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038361 Aug 02 11:02:59.447623 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 450/912] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Aug 2 11:02:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 11:02:59.454018 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-ad477de2-b316-477c-bc0e-6d1922e7b0b0 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:02:59.454938 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-ad477de2-b316-477c-bc0e-6d1922e7b0b0 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] [instance: 1ec98e47-e93b-4a79-ad3d-78e2dd1aa22a] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:02:59.466550 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-ad477de2-b316-477c-bc0e-6d1922e7b0b0 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:02:59.466550 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-ad477de2-b316-477c-bc0e-6d1922e7b0b0 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:02:59.466550 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-ad477de2-b316-477c-bc0e-6d1922e7b0b0 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:02:59.466550 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-ad477de2-b316-477c-bc0e-6d1922e7b0b0 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:02:59.534074 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-ad477de2-b316-477c-bc0e-6d1922e7b0b0 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ba1b5dac82438391a56b7cda25a363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dccda1fb9a44c3d91811677bd6f36c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:02:59.542076 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-ad477de2-b316-477c-bc0e-6d1922e7b0b0 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] 10.222.0.115 "GET /compute/v2.1/servers/1ec98e47-e93b-4a79-ad3d-78e2dd1aa22a" status: 200 len: 1221 microversion: 2.1 time: 0.093137 Aug 02 11:02:59.543566 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 451/913] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:02:59 2022] GET /compute/v2.1/servers/1ec98e47-e93b-4a79-ad3d-78e2dd1aa22a => generated 1221 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:02:59.828911 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-75a447d8-c571-486c-a26a-a18e11bc4389 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] 10.222.0.115 "DELETE /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83" status: 204 len: 0 microversion: 2.1 time: 0.660568 Aug 02 11:02:59.829461 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 463/914] 10.222.0.115 () {58 vars in 1244 bytes} [Tue Aug 2 11:02:59 2022] DELETE /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83 => generated 0 bytes in 662 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 11:02:59.840882 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-65877bc3-016c-46b5-a36c-3835d5014bb5 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:02:59.841655 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-65877bc3-016c-46b5-a36c-3835d5014bb5 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] [instance: 254a6894-dcb1-4909-a24e-a3a9bf701a83] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:02:59.850047 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-65877bc3-016c-46b5-a36c-3835d5014bb5 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:02:59.850714 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-65877bc3-016c-46b5-a36c-3835d5014bb5 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:02:59.851672 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-65877bc3-016c-46b5-a36c-3835d5014bb5 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:02:59.852104 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-65877bc3-016c-46b5-a36c-3835d5014bb5 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:00.434071 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-ac1d89e5-d872-4ee4-a6dc-9a271f6d5d65 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:03:00.434758 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-ac1d89e5-d872-4ee4-a6dc-9a271f6d5d65 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] [instance: fd09d54f-4850-44ab-b2e8-f58a339680b1] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:03:00.443282 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-ac1d89e5-d872-4ee4-a6dc-9a271f6d5d65 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:00.443996 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-ac1d89e5-d872-4ee4-a6dc-9a271f6d5d65 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:00.444761 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-ac1d89e5-d872-4ee4-a6dc-9a271f6d5d65 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:00.445145 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-ac1d89e5-d872-4ee4-a6dc-9a271f6d5d65 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:00.469632 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-65877bc3-016c-46b5-a36c-3835d5014bb5 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2664b70cbc1a41a59f78b0b7d4e86643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd54719e5f2b41e6a875361a9188d49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:03:00.481134 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-65877bc3-016c-46b5-a36c-3835d5014bb5 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] 10.222.0.115 "GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83" status: 200 len: 1570 microversion: 2.1 time: 0.646201 Aug 02 11:03:00.482290 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 452/915] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:02:59 2022] GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83 => generated 1570 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:03:00.564595 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-7fdc4506-a9f0-4a60-b982-4d59a63c9667 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:03:00.565322 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-7fdc4506-a9f0-4a60-b982-4d59a63c9667 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] [instance: 1ec98e47-e93b-4a79-ad3d-78e2dd1aa22a] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:03:00.571753 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-7fdc4506-a9f0-4a60-b982-4d59a63c9667 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:00.572420 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-7fdc4506-a9f0-4a60-b982-4d59a63c9667 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:00.573200 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-7fdc4506-a9f0-4a60-b982-4d59a63c9667 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:00.573646 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-7fdc4506-a9f0-4a60-b982-4d59a63c9667 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:00.608189 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-ac1d89e5-d872-4ee4-a6dc-9a271f6d5d65 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914de37664914b4cb91e0ce2c3a0e1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66234794284419a47e3afcae968084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:03:00.618682 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-ac1d89e5-d872-4ee4-a6dc-9a271f6d5d65 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] 10.222.0.115 "GET /compute/v2.1/servers/fd09d54f-4850-44ab-b2e8-f58a339680b1" status: 200 len: 1270 microversion: 2.1 time: 0.190219 Aug 02 11:03:00.619298 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 464/916] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:03:00 2022] GET /compute/v2.1/servers/fd09d54f-4850-44ab-b2e8-f58a339680b1 => generated 1270 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:03:00.640941 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-7fdc4506-a9f0-4a60-b982-4d59a63c9667 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ba1b5dac82438391a56b7cda25a363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dccda1fb9a44c3d91811677bd6f36c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:03:00.648951 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-7fdc4506-a9f0-4a60-b982-4d59a63c9667 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] 10.222.0.115 "GET /compute/v2.1/servers/1ec98e47-e93b-4a79-ad3d-78e2dd1aa22a" status: 200 len: 1213 microversion: 2.1 time: 0.088394 Aug 02 11:03:00.649506 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 453/917] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:03:00 2022] GET /compute/v2.1/servers/1ec98e47-e93b-4a79-ad3d-78e2dd1aa22a => generated 1213 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 11:03:01.512967 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-075e45eb-394d-4be6-809e-ea6c88fc2051 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:03:01.512967 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-075e45eb-394d-4be6-809e-ea6c88fc2051 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] [instance: 254a6894-dcb1-4909-a24e-a3a9bf701a83] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:03:01.513892 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-075e45eb-394d-4be6-809e-ea6c88fc2051 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:01.513892 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-075e45eb-394d-4be6-809e-ea6c88fc2051 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:01.515122 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-075e45eb-394d-4be6-809e-ea6c88fc2051 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:01.515732 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-075e45eb-394d-4be6-809e-ea6c88fc2051 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:01.644967 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-66829104-78b7-4ceb-95a5-c5466b3d319c tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:03:01.646093 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-66829104-78b7-4ceb-95a5-c5466b3d319c tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] [instance: fd09d54f-4850-44ab-b2e8-f58a339680b1] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:03:01.653886 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-66829104-78b7-4ceb-95a5-c5466b3d319c tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:01.654492 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-66829104-78b7-4ceb-95a5-c5466b3d319c tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:01.656553 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-66829104-78b7-4ceb-95a5-c5466b3d319c tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:01.656553 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-66829104-78b7-4ceb-95a5-c5466b3d319c tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:01.761347 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-075e45eb-394d-4be6-809e-ea6c88fc2051 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2664b70cbc1a41a59f78b0b7d4e86643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd54719e5f2b41e6a875361a9188d49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:03:01.768744 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-075e45eb-394d-4be6-809e-ea6c88fc2051 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] 10.222.0.115 "GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83" status: 200 len: 1570 microversion: 2.1 time: 0.268248 Aug 02 11:03:01.779073 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 465/918] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:03:01 2022] GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83 => generated 1570 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:03:01.779073 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-51555d0b-bf39-4d68-bb91-a085d60e4c8c tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:03:01.779073 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-51555d0b-bf39-4d68-bb91-a085d60e4c8c tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] [instance: 1ec98e47-e93b-4a79-ad3d-78e2dd1aa22a] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:03:01.783381 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-51555d0b-bf39-4d68-bb91-a085d60e4c8c tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:01.783809 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-51555d0b-bf39-4d68-bb91-a085d60e4c8c tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:01.784751 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-51555d0b-bf39-4d68-bb91-a085d60e4c8c tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:01.785831 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-51555d0b-bf39-4d68-bb91-a085d60e4c8c tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:01.867858 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-51555d0b-bf39-4d68-bb91-a085d60e4c8c tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ba1b5dac82438391a56b7cda25a363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dccda1fb9a44c3d91811677bd6f36c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:03:01.871992 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-66829104-78b7-4ceb-95a5-c5466b3d319c tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914de37664914b4cb91e0ce2c3a0e1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66234794284419a47e3afcae968084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:03:01.876167 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-51555d0b-bf39-4d68-bb91-a085d60e4c8c tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] 10.222.0.115 "GET /compute/v2.1/servers/1ec98e47-e93b-4a79-ad3d-78e2dd1aa22a" status: 200 len: 1213 microversion: 2.1 time: 0.104659 Aug 02 11:03:01.876876 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 466/919] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:03:01 2022] GET /compute/v2.1/servers/1ec98e47-e93b-4a79-ad3d-78e2dd1aa22a => generated 1213 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:03:01.898880 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-66829104-78b7-4ceb-95a5-c5466b3d319c tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] 10.222.0.115 "GET /compute/v2.1/servers/fd09d54f-4850-44ab-b2e8-f58a339680b1" status: 200 len: 1270 microversion: 2.1 time: 0.245472 Aug 02 11:03:01.902887 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 454/920] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:03:01 2022] GET /compute/v2.1/servers/fd09d54f-4850-44ab-b2e8-f58a339680b1 => generated 1270 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:03:02.110581 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [req-bf93afec-f3e6-45d9-af4c-e653b1f0566a req-e0064471-121b-4754-aa14-2dd2f696a8c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd09d54f-4850-44ab-b2e8-f58a339680b1", "name": "network-vif-plugged", "status": "completed", "tag": "0152f1cc-99ed-464f-a9fb-213142a00fb8"}]} {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 11:03:02.121238 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [req-bf93afec-f3e6-45d9-af4c-e653b1f0566a req-e0064471-121b-4754-aa14-2dd2f696a8c3 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:02.121754 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [req-bf93afec-f3e6-45d9-af4c-e653b1f0566a req-e0064471-121b-4754-aa14-2dd2f696a8c3 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:02.135260 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.compute.server_external_events [req-bf93afec-f3e6-45d9-af4c-e653b1f0566a req-e0064471-121b-4754-aa14-2dd2f696a8c3 service nova] Creating event network-vif-plugged:0152f1cc-99ed-464f-a9fb-213142a00fb8 for instance fd09d54f-4850-44ab-b2e8-f58a339680b1 on hv-cinder-85031 Aug 02 11:03:02.141360 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [req-bf93afec-f3e6-45d9-af4c-e653b1f0566a req-e0064471-121b-4754-aa14-2dd2f696a8c3 service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034481 Aug 02 11:03:02.142203 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 467/921] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Aug 2 11:03:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 11:03:02.501749 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [req-cfff953b-9593-498a-8bc8-0181af8d945c req-258e7bd1-7c10-4a61-a269-1a56ab490477 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "254a6894-dcb1-4909-a24e-a3a9bf701a83", "name": "network-vif-deleted", "tag": "950f72fe-d9c4-4546-b649-bf02fe995cd8"}]} {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 11:03:02.512582 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [req-cfff953b-9593-498a-8bc8-0181af8d945c req-258e7bd1-7c10-4a61-a269-1a56ab490477 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:02.513130 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [req-cfff953b-9593-498a-8bc8-0181af8d945c req-258e7bd1-7c10-4a61-a269-1a56ab490477 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:02.535487 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.compute.server_external_events [req-cfff953b-9593-498a-8bc8-0181af8d945c req-258e7bd1-7c10-4a61-a269-1a56ab490477 service nova] Creating event network-vif-deleted:950f72fe-d9c4-4546-b649-bf02fe995cd8 for instance 254a6894-dcb1-4909-a24e-a3a9bf701a83 on hv-cinder-85031 Aug 02 11:03:02.535487 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [req-cfff953b-9593-498a-8bc8-0181af8d945c req-258e7bd1-7c10-4a61-a269-1a56ab490477 service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036130 Aug 02 11:03:02.536077 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 455/922] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Aug 2 11:03:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 11:03:02.794282 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-0e831a8d-067a-453d-b038-76c25630a8db tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:03:02.795311 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-0e831a8d-067a-453d-b038-76c25630a8db tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] [instance: 254a6894-dcb1-4909-a24e-a3a9bf701a83] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:03:02.810777 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-0e831a8d-067a-453d-b038-76c25630a8db tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:02.818021 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-0e831a8d-067a-453d-b038-76c25630a8db tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:02.819504 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-0e831a8d-067a-453d-b038-76c25630a8db tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:02.823471 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-0e831a8d-067a-453d-b038-76c25630a8db tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:02.897780 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-0728dc0c-7ca4-41f5-8fdf-30722a8cd1a3 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:03:02.899149 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-0728dc0c-7ca4-41f5-8fdf-30722a8cd1a3 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] [instance: 1ec98e47-e93b-4a79-ad3d-78e2dd1aa22a] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:03:02.907459 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-0728dc0c-7ca4-41f5-8fdf-30722a8cd1a3 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:02.908365 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-0728dc0c-7ca4-41f5-8fdf-30722a8cd1a3 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:02.909433 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-0728dc0c-7ca4-41f5-8fdf-30722a8cd1a3 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:02.910601 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-0728dc0c-7ca4-41f5-8fdf-30722a8cd1a3 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:02.936792 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-0e831a8d-067a-453d-b038-76c25630a8db tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2664b70cbc1a41a59f78b0b7d4e86643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd54719e5f2b41e6a875361a9188d49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:03:02.946219 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-0e831a8d-067a-453d-b038-76c25630a8db tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] 10.222.0.115 "GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83" status: 200 len: 1384 microversion: 2.1 time: 0.157655 Aug 02 11:03:02.947263 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 468/923] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:03:02 2022] GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83 => generated 1384 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:03:02.952572 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-0c0000cd-44ab-4367-9907-b8e1f391d54c tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:03:02.953370 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-0c0000cd-44ab-4367-9907-b8e1f391d54c tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] [instance: fd09d54f-4850-44ab-b2e8-f58a339680b1] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:03:02.964011 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-0c0000cd-44ab-4367-9907-b8e1f391d54c tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:02.964759 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-0c0000cd-44ab-4367-9907-b8e1f391d54c tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:02.965754 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-0c0000cd-44ab-4367-9907-b8e1f391d54c tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:02.966363 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-0c0000cd-44ab-4367-9907-b8e1f391d54c tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:03.038027 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-0728dc0c-7ca4-41f5-8fdf-30722a8cd1a3 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ba1b5dac82438391a56b7cda25a363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dccda1fb9a44c3d91811677bd6f36c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:03:03.047974 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-0728dc0c-7ca4-41f5-8fdf-30722a8cd1a3 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] 10.222.0.115 "GET /compute/v2.1/servers/1ec98e47-e93b-4a79-ad3d-78e2dd1aa22a" status: 200 len: 1269 microversion: 2.1 time: 0.155090 Aug 02 11:03:03.048484 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 456/924] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:03:02 2022] GET /compute/v2.1/servers/1ec98e47-e93b-4a79-ad3d-78e2dd1aa22a => generated 1269 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:03:03.176739 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-0c0000cd-44ab-4367-9907-b8e1f391d54c tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914de37664914b4cb91e0ce2c3a0e1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66234794284419a47e3afcae968084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:03:03.184423 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-0c0000cd-44ab-4367-9907-b8e1f391d54c tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] 10.222.0.115 "GET /compute/v2.1/servers/fd09d54f-4850-44ab-b2e8-f58a339680b1" status: 200 len: 1270 microversion: 2.1 time: 0.235593 Aug 02 11:03:03.185227 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 469/925] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:03:02 2022] GET /compute/v2.1/servers/fd09d54f-4850-44ab-b2e8-f58a339680b1 => generated 1270 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:03:03.973644 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-ba677d54-3108-4f6e-a736-2203df227681 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:03:03.974387 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-ba677d54-3108-4f6e-a736-2203df227681 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] [instance: 254a6894-dcb1-4909-a24e-a3a9bf701a83] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:03:03.984878 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-ba677d54-3108-4f6e-a736-2203df227681 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:03.984878 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-ba677d54-3108-4f6e-a736-2203df227681 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:03.984878 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-ba677d54-3108-4f6e-a736-2203df227681 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:03.984878 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-ba677d54-3108-4f6e-a736-2203df227681 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:04.051264 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-ba677d54-3108-4f6e-a736-2203df227681 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2664b70cbc1a41a59f78b0b7d4e86643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd54719e5f2b41e6a875361a9188d49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:03:04.061270 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-ba677d54-3108-4f6e-a736-2203df227681 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] 10.222.0.115 "GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83" status: 200 len: 1223 microversion: 2.1 time: 0.093438 Aug 02 11:03:04.071372 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 457/926] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:03:03 2022] GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83 => generated 1223 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:03:04.080905 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-bcdd79ea-7e64-4c7c-9a48-22181d468b39 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:03:04.082007 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-bcdd79ea-7e64-4c7c-9a48-22181d468b39 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] [instance: 1ec98e47-e93b-4a79-ad3d-78e2dd1aa22a] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:03:04.090124 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-bcdd79ea-7e64-4c7c-9a48-22181d468b39 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:04.090565 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-bcdd79ea-7e64-4c7c-9a48-22181d468b39 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:04.091604 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-bcdd79ea-7e64-4c7c-9a48-22181d468b39 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:04.092146 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-bcdd79ea-7e64-4c7c-9a48-22181d468b39 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:04.162042 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-bcdd79ea-7e64-4c7c-9a48-22181d468b39 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ba1b5dac82438391a56b7cda25a363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dccda1fb9a44c3d91811677bd6f36c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:03:04.170066 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-bcdd79ea-7e64-4c7c-9a48-22181d468b39 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] 10.222.0.115 "GET /compute/v2.1/servers/1ec98e47-e93b-4a79-ad3d-78e2dd1aa22a" status: 200 len: 1275 microversion: 2.1 time: 0.095505 Aug 02 11:03:04.170657 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 470/927] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:03:04 2022] GET /compute/v2.1/servers/1ec98e47-e93b-4a79-ad3d-78e2dd1aa22a => generated 1275 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:03:04.207552 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-d8efe1f0-2ba4-42a7-b202-3d7e60f07866 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:03:04.210288 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-d8efe1f0-2ba4-42a7-b202-3d7e60f07866 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] [instance: fd09d54f-4850-44ab-b2e8-f58a339680b1] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:03:04.225525 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-d8efe1f0-2ba4-42a7-b202-3d7e60f07866 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:04.225978 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-d8efe1f0-2ba4-42a7-b202-3d7e60f07866 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:04.226764 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-d8efe1f0-2ba4-42a7-b202-3d7e60f07866 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:04.227429 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-d8efe1f0-2ba4-42a7-b202-3d7e60f07866 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:04.365772 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-d8efe1f0-2ba4-42a7-b202-3d7e60f07866 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914de37664914b4cb91e0ce2c3a0e1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66234794284419a47e3afcae968084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:03:04.374497 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-d8efe1f0-2ba4-42a7-b202-3d7e60f07866 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] 10.222.0.115 "GET /compute/v2.1/servers/fd09d54f-4850-44ab-b2e8-f58a339680b1" status: 200 len: 1456 microversion: 2.1 time: 0.172279 Aug 02 11:03:04.375121 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 458/928] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:03:04 2022] GET /compute/v2.1/servers/fd09d54f-4850-44ab-b2e8-f58a339680b1 => generated 1456 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:03:04.402225 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-b035b7cf-db84-4df0-b663-afa662993404 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:03:04.402952 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-b035b7cf-db84-4df0-b663-afa662993404 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] [instance: fd09d54f-4850-44ab-b2e8-f58a339680b1] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:03:04.412159 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-b035b7cf-db84-4df0-b663-afa662993404 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:04.412684 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-b035b7cf-db84-4df0-b663-afa662993404 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:04.413918 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-b035b7cf-db84-4df0-b663-afa662993404 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:04.414373 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-b035b7cf-db84-4df0-b663-afa662993404 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:04.615677 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-b035b7cf-db84-4df0-b663-afa662993404 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914de37664914b4cb91e0ce2c3a0e1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66234794284419a47e3afcae968084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:03:04.626633 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-b035b7cf-db84-4df0-b663-afa662993404 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] 10.222.0.115 "GET /compute/v2.1/servers/fd09d54f-4850-44ab-b2e8-f58a339680b1" status: 200 len: 1456 microversion: 2.1 time: 0.230970 Aug 02 11:03:04.640654 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 471/929] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:03:04 2022] GET /compute/v2.1/servers/fd09d54f-4850-44ab-b2e8-f58a339680b1 => generated 1456 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:03:05.082419 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-f359b5fe-ade6-4daf-87ab-43f491dc2fad tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:03:05.083281 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-f359b5fe-ade6-4daf-87ab-43f491dc2fad tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] [instance: 254a6894-dcb1-4909-a24e-a3a9bf701a83] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:03:05.090355 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-f359b5fe-ade6-4daf-87ab-43f491dc2fad tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:05.091030 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-f359b5fe-ade6-4daf-87ab-43f491dc2fad tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:05.092204 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-f359b5fe-ade6-4daf-87ab-43f491dc2fad tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:05.093093 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-f359b5fe-ade6-4daf-87ab-43f491dc2fad tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:05.098915 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG dbcounter [-] [129952] Writing DB stats nova_cell1:SELECT=100 {{(pid=129952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 11:03:05.134061 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-f359b5fe-ade6-4daf-87ab-43f491dc2fad tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:05.134527 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-f359b5fe-ade6-4daf-87ab-43f491dc2fad tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:05.135183 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.objects.instance [None req-f359b5fe-ade6-4daf-87ab-43f491dc2fad tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lazy-loading 'fault' on Instance uuid 254a6894-dcb1-4909-a24e-a3a9bf701a83 {{(pid=129952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 11:03:05.196684 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-e65375ef-2bcc-47d8-b119-86d95bb2d216 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:03:05.198079 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-e65375ef-2bcc-47d8-b119-86d95bb2d216 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] [instance: 1ec98e47-e93b-4a79-ad3d-78e2dd1aa22a] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:03:05.213747 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-e65375ef-2bcc-47d8-b119-86d95bb2d216 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:05.219756 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-e65375ef-2bcc-47d8-b119-86d95bb2d216 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:05.219756 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-e65375ef-2bcc-47d8-b119-86d95bb2d216 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:05.219756 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-e65375ef-2bcc-47d8-b119-86d95bb2d216 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:05.227943 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG dbcounter [-] [129953] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 11:03:05.272912 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-f359b5fe-ade6-4daf-87ab-43f491dc2fad tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2664b70cbc1a41a59f78b0b7d4e86643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd54719e5f2b41e6a875361a9188d49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:03:05.281079 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-f359b5fe-ade6-4daf-87ab-43f491dc2fad tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] 10.222.0.115 "GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83" status: 200 len: 1228 microversion: 2.1 time: 0.203082 Aug 02 11:03:05.296976 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 459/930] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:03:05 2022] GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83 => generated 1228 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:03:05.485858 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-e65375ef-2bcc-47d8-b119-86d95bb2d216 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ba1b5dac82438391a56b7cda25a363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dccda1fb9a44c3d91811677bd6f36c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:03:05.498763 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [req-676eba90-b590-4bc2-9411-81c3e5190ccd req-1de337b3-9ebb-419a-ba1e-054fb1b575e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ec98e47-e93b-4a79-ad3d-78e2dd1aa22a", "tag": "999cc6b7-f63b-4ef6-8bf3-e48cd643909b"}]} {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 11:03:05.502011 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-e65375ef-2bcc-47d8-b119-86d95bb2d216 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] 10.222.0.115 "GET /compute/v2.1/servers/1ec98e47-e93b-4a79-ad3d-78e2dd1aa22a" status: 200 len: 1317 microversion: 2.1 time: 0.307606 Aug 02 11:03:05.502011 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 472/931] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:03:05 2022] GET /compute/v2.1/servers/1ec98e47-e93b-4a79-ad3d-78e2dd1aa22a => generated 1317 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:03:05.512408 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [req-676eba90-b590-4bc2-9411-81c3e5190ccd req-1de337b3-9ebb-419a-ba1e-054fb1b575e5 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:05.512852 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [req-676eba90-b590-4bc2-9411-81c3e5190ccd req-1de337b3-9ebb-419a-ba1e-054fb1b575e5 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:05.526718 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.compute.server_external_events [req-676eba90-b590-4bc2-9411-81c3e5190ccd req-1de337b3-9ebb-419a-ba1e-054fb1b575e5 service nova] Creating event network-changed:999cc6b7-f63b-4ef6-8bf3-e48cd643909b for instance 1ec98e47-e93b-4a79-ad3d-78e2dd1aa22a on hv-cinder-85031 Aug 02 11:03:05.532097 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [req-676eba90-b590-4bc2-9411-81c3e5190ccd req-1de337b3-9ebb-419a-ba1e-054fb1b575e5 service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041497 Aug 02 11:03:05.532708 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 460/932] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Aug 2 11:03:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 11:03:06.303745 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-c221c32b-61da-4659-8ece-bc2968d3103d tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:03:06.304361 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-c221c32b-61da-4659-8ece-bc2968d3103d tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] [instance: 254a6894-dcb1-4909-a24e-a3a9bf701a83] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:03:06.317220 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-c221c32b-61da-4659-8ece-bc2968d3103d tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:06.318633 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-c221c32b-61da-4659-8ece-bc2968d3103d tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:06.319681 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-c221c32b-61da-4659-8ece-bc2968d3103d tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:06.320305 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-c221c32b-61da-4659-8ece-bc2968d3103d tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:06.340963 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.wsgi [None req-c221c32b-61da-4659-8ece-bc2968d3103d tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] HTTP exception thrown: Instance 254a6894-dcb1-4909-a24e-a3a9bf701a83 could not be found. Aug 02 11:03:06.343549 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-c221c32b-61da-4659-8ece-bc2968d3103d tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Request method failure captured: Aug 02 11:03:06.343549 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: request: GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83 HTTP/1.1 Aug 02 11:03:06.343549 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Accept: application/json Aug 02 11:03:06.343549 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Accept-Encoding: identity Aug 02 11:03:06.343549 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Connection: close Aug 02 11:03:06.343549 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Content-Length: 0 Aug 02 11:03:06.343549 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Content-Type: application/json Aug 02 11:03:06.343549 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Host: 10.222.0.115 Aug 02 11:03:06.343549 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Openstack-System-Scope: None Aug 02 11:03:06.343549 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: User-Agent: python-urllib3/1.26.10 Aug 02 11:03:06.343549 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Auth-Token: gAAAAABi6QMHAhz7VHKx95S8g6HM9RvxIR-sDfAN_dftnY-XNJrwQpta6u4wz_LgM-YCXObYxtlReNEnivlLJ_eIgiXy0MkRi7vGSKJFgPYRVhtou6tqzurGAv_EjHE29_GRTWg2ag9qbXF8kaej7PVK3jyjTOkI2v7NcoA-1e6imjlKTcqaAZw Aug 02 11:03:06.343549 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Domain-Id: None Aug 02 11:03:06.343549 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Domain-Name: None Aug 02 11:03:06.343549 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Identity-Status: Confirmed Aug 02 11:03:06.343549 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Is-Admin-Project: True Aug 02 11:03:06.343549 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Project-Domain-Id: default Aug 02 11:03:06.343549 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Project-Domain-Name: Default Aug 02 11:03:06.343549 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Project-Id: cd54719e5f2b41e6a875361a9188d49b Aug 02 11:03:06.343549 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Project-Name: tempest-TestShelveInstance-1392668144 Aug 02 11:03:06.343549 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Role: reader,member Aug 02 11:03:06.343549 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Roles: reader,member Aug 02 11:03:06.345290 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/cd54719e5f2b41e6a875361a9188d49b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2/cd54719e5f2b41e6a875361a9188d49b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/cd54719e5f2b41e6a875361a9188d49b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.115:8080", "publicURL": "http://10.222.0.115:8080/v1/AUTH_cd54719e5f2b41e6a875361a9188d49b"}]}] Aug 02 11:03:06.345290 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Tenant: tempest-TestShelveInstance-1392668144 Aug 02 11:03:06.345290 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Tenant-Id: cd54719e5f2b41e6a875361a9188d49b Aug 02 11:03:06.345290 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Tenant-Name: tempest-TestShelveInstance-1392668144 Aug 02 11:03:06.345290 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User: tempest-TestShelveInstance-1392668144-project Aug 02 11:03:06.345290 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User-Domain-Id: default Aug 02 11:03:06.345290 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User-Domain-Name: Default Aug 02 11:03:06.345290 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User-Id: 2664b70cbc1a41a59f78b0b7d4e86643 Aug 02 11:03:06.345290 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User-Name: tempest-TestShelveInstance-1392668144-project Aug 02 11:03:06.345290 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: method: > Aug 02 11:03:06.345290 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: exception: Instance 254a6894-dcb1-4909-a24e-a3a9bf701a83 could not be found. Aug 02 11:03:06.345290 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: action_args: {'id': '254a6894-dcb1-4909-a24e-a3a9bf701a83'} Aug 02 11:03:06.346548 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 11:03:06.346548 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:03:06.346548 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 11:03:06.346548 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 11:03:06.346548 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 11:03:06.346548 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 11:03:06.346548 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 11:03:06.346548 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 11:03:06.346548 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 11:03:06.346548 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 11:03:06.346548 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 254a6894-dcb1-4909-a24e-a3a9bf701a83 could not be found. Aug 02 11:03:06.346548 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 11:03:06.346548 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 11:03:06.346548 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 11:03:06.346548 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:03:06.346548 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 11:03:06.346548 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 11:03:06.346548 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 11:03:06.346548 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 11:03:06.346548 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 11:03:06.349450 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 11:03:06.349450 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 11:03:06.349450 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 11:03:06.349450 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 11:03:06.349450 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 11:03:06.349450 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 11:03:06.349450 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 11:03:06.349450 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 254a6894-dcb1-4909-a24e-a3a9bf701a83 could not be found. Aug 02 11:03:06.349450 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 11:03:06.349450 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 11:03:06.349450 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 11:03:06.349450 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:03:06.349450 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 11:03:06.349450 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 11:03:06.349450 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 11:03:06.349450 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 11:03:06.349450 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 254a6894-dcb1-4909-a24e-a3a9bf701a83 could not be found. Aug 02 11:03:06.349450 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 11:03:06.352990 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-c221c32b-61da-4659-8ece-bc2968d3103d tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Returning 404 to user: Instance 254a6894-dcb1-4909-a24e-a3a9bf701a83 could not be found. {{(pid=129953) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 11:03:06.354460 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-c221c32b-61da-4659-8ece-bc2968d3103d tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] 10.222.0.115 "GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83" status: 404 len: 111 microversion: 2.1 time: 0.055090 Aug 02 11:03:06.355644 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 473/933] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:03:06 2022] GET /compute/v2.1/servers/254a6894-dcb1-4909-a24e-a3a9bf701a83 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 11:03:06.528522 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-599a1b05-cf9a-44b2-a80f-3a4e0f843fab tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:03:06.531516 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-599a1b05-cf9a-44b2-a80f-3a4e0f843fab tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] [instance: 1ec98e47-e93b-4a79-ad3d-78e2dd1aa22a] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:03:06.546323 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-599a1b05-cf9a-44b2-a80f-3a4e0f843fab tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:06.548214 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-599a1b05-cf9a-44b2-a80f-3a4e0f843fab tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:06.550115 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-599a1b05-cf9a-44b2-a80f-3a4e0f843fab tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:06.550995 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-599a1b05-cf9a-44b2-a80f-3a4e0f843fab tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:06.753452 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-cc0d4a31-206b-4115-8e96-5a4e5ca0b4b3 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] Calling method '.version_select at 0x7f7c5769c280>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:03:06.809921 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-599a1b05-cf9a-44b2-a80f-3a4e0f843fab tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ba1b5dac82438391a56b7cda25a363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dccda1fb9a44c3d91811677bd6f36c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:03:06.818332 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-599a1b05-cf9a-44b2-a80f-3a4e0f843fab tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] 10.222.0.115 "GET /compute/v2.1/servers/1ec98e47-e93b-4a79-ad3d-78e2dd1aa22a" status: 200 len: 1317 microversion: 2.1 time: 0.297388 Aug 02 11:03:06.822131 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 461/934] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:03:06 2022] GET /compute/v2.1/servers/1ec98e47-e93b-4a79-ad3d-78e2dd1aa22a => generated 1317 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:03:06.877649 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-cc0d4a31-206b-4115-8e96-5a4e5ca0b4b3 tempest-TestShelveInstance-1392668144 tempest-TestShelveInstance-1392668144-project] 10.222.0.115 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2083744582" status: 202 len: 0 microversion: 2.1 time: 0.129393 Aug 02 11:03:06.878255 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 474/935] 10.222.0.115 () {58 vars in 1259 bytes} [Tue Aug 2 11:03:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2083744582 => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 11:03:07.840999 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-dfe72788-e264-455c-9151-c4d1bf441366 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:03:07.842358 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-dfe72788-e264-455c-9151-c4d1bf441366 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] [instance: 1ec98e47-e93b-4a79-ad3d-78e2dd1aa22a] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:03:07.851978 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-dfe72788-e264-455c-9151-c4d1bf441366 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:07.853325 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-dfe72788-e264-455c-9151-c4d1bf441366 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:07.856401 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-dfe72788-e264-455c-9151-c4d1bf441366 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:07.857161 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-dfe72788-e264-455c-9151-c4d1bf441366 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:07.892126 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [req-1b7201fa-2d7c-4404-bbf8-8059f723ec8f req-a94873aa-caba-4e37-a376-bb4124eca118 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd09d54f-4850-44ab-b2e8-f58a339680b1", "tag": "0152f1cc-99ed-464f-a9fb-213142a00fb8"}]} {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 11:03:07.921450 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [req-1b7201fa-2d7c-4404-bbf8-8059f723ec8f req-a94873aa-caba-4e37-a376-bb4124eca118 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:07.921898 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [req-1b7201fa-2d7c-4404-bbf8-8059f723ec8f req-a94873aa-caba-4e37-a376-bb4124eca118 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:07.942711 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.compute.server_external_events [req-1b7201fa-2d7c-4404-bbf8-8059f723ec8f req-a94873aa-caba-4e37-a376-bb4124eca118 service nova] Creating event network-changed:0152f1cc-99ed-464f-a9fb-213142a00fb8 for instance fd09d54f-4850-44ab-b2e8-f58a339680b1 on hv-cinder-85031 Aug 02 11:03:07.956285 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [req-1b7201fa-2d7c-4404-bbf8-8059f723ec8f req-a94873aa-caba-4e37-a376-bb4124eca118 service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069205 Aug 02 11:03:07.957178 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 475/936] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Aug 2 11:03:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 11:03:08.189072 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-dfe72788-e264-455c-9151-c4d1bf441366 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ba1b5dac82438391a56b7cda25a363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dccda1fb9a44c3d91811677bd6f36c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:03:08.219333 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-dfe72788-e264-455c-9151-c4d1bf441366 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] 10.222.0.115 "GET /compute/v2.1/servers/1ec98e47-e93b-4a79-ad3d-78e2dd1aa22a" status: 200 len: 1317 microversion: 2.1 time: 0.374291 Aug 02 11:03:08.223540 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 462/937] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:03:07 2022] GET /compute/v2.1/servers/1ec98e47-e93b-4a79-ad3d-78e2dd1aa22a => generated 1317 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:03:09.240671 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG dbcounter [-] [129953] Writing DB stats nova_cell0:SELECT=2 {{(pid=129953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 11:03:09.241543 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG dbcounter [-] [129953] Writing DB stats nova_cell0:SELECT=6 {{(pid=129953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 11:03:09.250339 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-e005d578-9d3d-4e7e-b5c0-9eef0581fc81 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:03:09.250339 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-e005d578-9d3d-4e7e-b5c0-9eef0581fc81 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] [instance: 1ec98e47-e93b-4a79-ad3d-78e2dd1aa22a] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:03:09.254301 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-e005d578-9d3d-4e7e-b5c0-9eef0581fc81 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:09.254753 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-e005d578-9d3d-4e7e-b5c0-9eef0581fc81 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:09.255556 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-e005d578-9d3d-4e7e-b5c0-9eef0581fc81 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:09.255994 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-e005d578-9d3d-4e7e-b5c0-9eef0581fc81 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:09.779634 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-e005d578-9d3d-4e7e-b5c0-9eef0581fc81 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ba1b5dac82438391a56b7cda25a363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dccda1fb9a44c3d91811677bd6f36c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:03:09.789322 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-e005d578-9d3d-4e7e-b5c0-9eef0581fc81 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] 10.222.0.115 "GET /compute/v2.1/servers/1ec98e47-e93b-4a79-ad3d-78e2dd1aa22a" status: 200 len: 1317 microversion: 2.1 time: 0.549492 Aug 02 11:03:09.790305 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 476/938] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:03:09 2022] GET /compute/v2.1/servers/1ec98e47-e93b-4a79-ad3d-78e2dd1aa22a => generated 1317 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:03:10.241296 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [req-bf2dd099-ca89-4362-a826-dc3c4fd9c66f req-c10099ca-1a93-4506-84be-f8f593bfa99a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ec98e47-e93b-4a79-ad3d-78e2dd1aa22a", "name": "network-vif-plugged", "status": "completed", "tag": "999cc6b7-f63b-4ef6-8bf3-e48cd643909b"}]} {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 11:03:10.253680 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG dbcounter [-] [129952] Writing DB stats nova_cell0:SELECT=2 {{(pid=129952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 11:03:10.259954 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [req-bf2dd099-ca89-4362-a826-dc3c4fd9c66f req-c10099ca-1a93-4506-84be-f8f593bfa99a service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:10.260410 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [req-bf2dd099-ca89-4362-a826-dc3c4fd9c66f req-c10099ca-1a93-4506-84be-f8f593bfa99a service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:10.276995 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.compute.server_external_events [req-bf2dd099-ca89-4362-a826-dc3c4fd9c66f req-c10099ca-1a93-4506-84be-f8f593bfa99a service nova] Creating event network-vif-plugged:999cc6b7-f63b-4ef6-8bf3-e48cd643909b for instance 1ec98e47-e93b-4a79-ad3d-78e2dd1aa22a on hv-cinder-85031 Aug 02 11:03:10.283594 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [req-bf2dd099-ca89-4362-a826-dc3c4fd9c66f req-c10099ca-1a93-4506-84be-f8f593bfa99a service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044870 Aug 02 11:03:10.286416 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 463/939] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Aug 2 11:03:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 11:03:10.810373 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-d9283580-5f6c-4b11-ac42-433c32376d66 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:03:10.811036 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-d9283580-5f6c-4b11-ac42-433c32376d66 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] [instance: 1ec98e47-e93b-4a79-ad3d-78e2dd1aa22a] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:03:10.821139 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-d9283580-5f6c-4b11-ac42-433c32376d66 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:10.821581 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-d9283580-5f6c-4b11-ac42-433c32376d66 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:10.822491 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-d9283580-5f6c-4b11-ac42-433c32376d66 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:10.823135 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-d9283580-5f6c-4b11-ac42-433c32376d66 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:11.070739 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-d9283580-5f6c-4b11-ac42-433c32376d66 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ba1b5dac82438391a56b7cda25a363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dccda1fb9a44c3d91811677bd6f36c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:03:11.079557 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-d9283580-5f6c-4b11-ac42-433c32376d66 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] 10.222.0.115 "GET /compute/v2.1/servers/1ec98e47-e93b-4a79-ad3d-78e2dd1aa22a" status: 200 len: 1317 microversion: 2.1 time: 0.272999 Aug 02 11:03:11.103878 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 477/940] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:03:10 2022] GET /compute/v2.1/servers/1ec98e47-e93b-4a79-ad3d-78e2dd1aa22a => generated 1317 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:03:12.107560 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-7add200b-3def-48e1-ae87-80fde982395c tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:03:12.108308 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-7add200b-3def-48e1-ae87-80fde982395c tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] [instance: 1ec98e47-e93b-4a79-ad3d-78e2dd1aa22a] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:03:12.110823 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG dbcounter [-] [129952] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=3 {{(pid=129952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 11:03:12.117097 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-7add200b-3def-48e1-ae87-80fde982395c tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:12.117557 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-7add200b-3def-48e1-ae87-80fde982395c tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:12.118386 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-7add200b-3def-48e1-ae87-80fde982395c tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:12.118852 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-7add200b-3def-48e1-ae87-80fde982395c tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:12.320576 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-7add200b-3def-48e1-ae87-80fde982395c tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ba1b5dac82438391a56b7cda25a363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dccda1fb9a44c3d91811677bd6f36c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:03:12.342297 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-7add200b-3def-48e1-ae87-80fde982395c tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] 10.222.0.115 "GET /compute/v2.1/servers/1ec98e47-e93b-4a79-ad3d-78e2dd1aa22a" status: 200 len: 1317 microversion: 2.1 time: 0.240022 Aug 02 11:03:12.342890 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 464/941] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:03:12 2022] GET /compute/v2.1/servers/1ec98e47-e93b-4a79-ad3d-78e2dd1aa22a => generated 1317 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:03:13.365721 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-b904def3-6c1d-4980-b163-6236a1f267b8 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:03:13.366364 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-b904def3-6c1d-4980-b163-6236a1f267b8 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] [instance: 1ec98e47-e93b-4a79-ad3d-78e2dd1aa22a] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:03:13.373145 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-b904def3-6c1d-4980-b163-6236a1f267b8 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:13.373718 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-b904def3-6c1d-4980-b163-6236a1f267b8 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:13.375225 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-b904def3-6c1d-4980-b163-6236a1f267b8 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:13.375225 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-b904def3-6c1d-4980-b163-6236a1f267b8 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:13.586873 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-b904def3-6c1d-4980-b163-6236a1f267b8 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ba1b5dac82438391a56b7cda25a363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dccda1fb9a44c3d91811677bd6f36c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:03:13.594512 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-b904def3-6c1d-4980-b163-6236a1f267b8 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] 10.222.0.115 "GET /compute/v2.1/servers/1ec98e47-e93b-4a79-ad3d-78e2dd1aa22a" status: 200 len: 1317 microversion: 2.1 time: 0.232699 Aug 02 11:03:13.595105 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 478/942] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:03:13 2022] GET /compute/v2.1/servers/1ec98e47-e93b-4a79-ad3d-78e2dd1aa22a => generated 1317 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:03:14.617546 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-acc674fc-52a4-42d8-b7d5-3dfb32cb8d26 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:03:14.618319 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-acc674fc-52a4-42d8-b7d5-3dfb32cb8d26 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] [instance: 1ec98e47-e93b-4a79-ad3d-78e2dd1aa22a] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:03:14.634985 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-acc674fc-52a4-42d8-b7d5-3dfb32cb8d26 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:14.635518 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-acc674fc-52a4-42d8-b7d5-3dfb32cb8d26 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:14.636329 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-acc674fc-52a4-42d8-b7d5-3dfb32cb8d26 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:14.636761 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-acc674fc-52a4-42d8-b7d5-3dfb32cb8d26 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:14.892589 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-acc674fc-52a4-42d8-b7d5-3dfb32cb8d26 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ba1b5dac82438391a56b7cda25a363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dccda1fb9a44c3d91811677bd6f36c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:03:14.902723 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-acc674fc-52a4-42d8-b7d5-3dfb32cb8d26 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] 10.222.0.115 "GET /compute/v2.1/servers/1ec98e47-e93b-4a79-ad3d-78e2dd1aa22a" status: 200 len: 1317 microversion: 2.1 time: 0.291139 Aug 02 11:03:14.903668 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 465/943] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:03:14 2022] GET /compute/v2.1/servers/1ec98e47-e93b-4a79-ad3d-78e2dd1aa22a => generated 1317 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:03:15.932926 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-df37f6d0-84a2-4a6d-ae5e-778ff2a4656f tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:03:15.934244 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-df37f6d0-84a2-4a6d-ae5e-778ff2a4656f tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] [instance: 1ec98e47-e93b-4a79-ad3d-78e2dd1aa22a] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:03:15.938038 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG dbcounter [-] [129953] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 11:03:15.946726 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-df37f6d0-84a2-4a6d-ae5e-778ff2a4656f tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:15.947159 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-df37f6d0-84a2-4a6d-ae5e-778ff2a4656f tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:15.947948 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-df37f6d0-84a2-4a6d-ae5e-778ff2a4656f tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:15.955299 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-df37f6d0-84a2-4a6d-ae5e-778ff2a4656f tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:16.183089 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-df37f6d0-84a2-4a6d-ae5e-778ff2a4656f tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ba1b5dac82438391a56b7cda25a363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dccda1fb9a44c3d91811677bd6f36c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:03:16.191873 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-df37f6d0-84a2-4a6d-ae5e-778ff2a4656f tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] 10.222.0.115 "GET /compute/v2.1/servers/1ec98e47-e93b-4a79-ad3d-78e2dd1aa22a" status: 200 len: 1501 microversion: 2.1 time: 0.269561 Aug 02 11:03:16.192535 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 479/944] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:03:15 2022] GET /compute/v2.1/servers/1ec98e47-e93b-4a79-ad3d-78e2dd1aa22a => generated 1501 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:03:17.394895 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-490d3e75-d7ef-4bfa-9ca9-78d32fa068d4 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:03:17.396063 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-490d3e75-d7ef-4bfa-9ca9-78d32fa068d4 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] [instance: 1ec98e47-e93b-4a79-ad3d-78e2dd1aa22a] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:03:17.403282 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-490d3e75-d7ef-4bfa-9ca9-78d32fa068d4 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:17.404093 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-490d3e75-d7ef-4bfa-9ca9-78d32fa068d4 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:17.405180 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-490d3e75-d7ef-4bfa-9ca9-78d32fa068d4 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:17.405818 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-490d3e75-d7ef-4bfa-9ca9-78d32fa068d4 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:17.462770 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-490d3e75-d7ef-4bfa-9ca9-78d32fa068d4 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] [instance: 1ec98e47-e93b-4a79-ad3d-78e2dd1aa22a] Going to try to terminate instance {{(pid=129952) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 11:03:17.928271 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-490d3e75-d7ef-4bfa-9ca9-78d32fa068d4 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] 10.222.0.115 "DELETE /compute/v2.1/servers/1ec98e47-e93b-4a79-ad3d-78e2dd1aa22a" status: 204 len: 0 microversion: 2.1 time: 0.537055 Aug 02 11:03:17.929030 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 466/945] 10.222.0.115 () {58 vars in 1244 bytes} [Tue Aug 2 11:03:17 2022] DELETE /compute/v2.1/servers/1ec98e47-e93b-4a79-ad3d-78e2dd1aa22a => generated 0 bytes in 539 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 11:03:17.937625 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-ee8a8978-bc05-416c-a321-2bd03928ca77 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:03:17.938238 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-ee8a8978-bc05-416c-a321-2bd03928ca77 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] [instance: 1ec98e47-e93b-4a79-ad3d-78e2dd1aa22a] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:03:17.946172 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-ee8a8978-bc05-416c-a321-2bd03928ca77 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:17.946556 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-ee8a8978-bc05-416c-a321-2bd03928ca77 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:17.947469 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-ee8a8978-bc05-416c-a321-2bd03928ca77 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:17.947960 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-ee8a8978-bc05-416c-a321-2bd03928ca77 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:18.102547 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-ee8a8978-bc05-416c-a321-2bd03928ca77 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ba1b5dac82438391a56b7cda25a363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dccda1fb9a44c3d91811677bd6f36c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:03:18.110349 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-ee8a8978-bc05-416c-a321-2bd03928ca77 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] 10.222.0.115 "GET /compute/v2.1/servers/1ec98e47-e93b-4a79-ad3d-78e2dd1aa22a" status: 200 len: 1507 microversion: 2.1 time: 0.176770 Aug 02 11:03:18.113649 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 480/946] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:03:17 2022] GET /compute/v2.1/servers/1ec98e47-e93b-4a79-ad3d-78e2dd1aa22a => generated 1507 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:03:19.133664 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-f65ecd9b-c774-460d-8fdc-d957723f3a5f tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:03:19.135101 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-f65ecd9b-c774-460d-8fdc-d957723f3a5f tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] [instance: 1ec98e47-e93b-4a79-ad3d-78e2dd1aa22a] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:03:19.143182 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-f65ecd9b-c774-460d-8fdc-d957723f3a5f tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:19.143566 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-f65ecd9b-c774-460d-8fdc-d957723f3a5f tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:19.144847 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-f65ecd9b-c774-460d-8fdc-d957723f3a5f tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:19.145564 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-f65ecd9b-c774-460d-8fdc-d957723f3a5f tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:19.305267 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-f65ecd9b-c774-460d-8fdc-d957723f3a5f tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ba1b5dac82438391a56b7cda25a363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dccda1fb9a44c3d91811677bd6f36c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:03:19.313039 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-f65ecd9b-c774-460d-8fdc-d957723f3a5f tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] 10.222.0.115 "GET /compute/v2.1/servers/1ec98e47-e93b-4a79-ad3d-78e2dd1aa22a" status: 200 len: 1507 microversion: 2.1 time: 0.183843 Aug 02 11:03:19.313677 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 467/947] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:03:19 2022] GET /compute/v2.1/servers/1ec98e47-e93b-4a79-ad3d-78e2dd1aa22a => generated 1507 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:03:20.279553 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [req-6afbd87a-5507-4a14-8046-8c456d01a9a0 req-d7b95b11-8a8e-44ee-b6df-347207bd8d2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ec98e47-e93b-4a79-ad3d-78e2dd1aa22a", "name": "network-vif-deleted", "tag": "999cc6b7-f63b-4ef6-8bf3-e48cd643909b"}]} {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 11:03:20.292815 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [req-6afbd87a-5507-4a14-8046-8c456d01a9a0 req-d7b95b11-8a8e-44ee-b6df-347207bd8d2b service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:20.293293 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [req-6afbd87a-5507-4a14-8046-8c456d01a9a0 req-d7b95b11-8a8e-44ee-b6df-347207bd8d2b service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:20.313112 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.compute.server_external_events [req-6afbd87a-5507-4a14-8046-8c456d01a9a0 req-d7b95b11-8a8e-44ee-b6df-347207bd8d2b service nova] Creating event network-vif-deleted:999cc6b7-f63b-4ef6-8bf3-e48cd643909b for instance 1ec98e47-e93b-4a79-ad3d-78e2dd1aa22a on hv-cinder-85031 Aug 02 11:03:20.319912 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [req-6afbd87a-5507-4a14-8046-8c456d01a9a0 req-d7b95b11-8a8e-44ee-b6df-347207bd8d2b service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043963 Aug 02 11:03:20.320577 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 481/948] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Aug 2 11:03:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 11:03:20.334617 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-7e37db19-dc5b-4890-b84d-42ecf88f9f81 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:03:20.335389 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-7e37db19-dc5b-4890-b84d-42ecf88f9f81 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] [instance: 1ec98e47-e93b-4a79-ad3d-78e2dd1aa22a] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:03:20.342720 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-7e37db19-dc5b-4890-b84d-42ecf88f9f81 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:20.343210 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-7e37db19-dc5b-4890-b84d-42ecf88f9f81 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:20.343995 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-7e37db19-dc5b-4890-b84d-42ecf88f9f81 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:20.344435 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-7e37db19-dc5b-4890-b84d-42ecf88f9f81 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:20.417410 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-7e37db19-dc5b-4890-b84d-42ecf88f9f81 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ba1b5dac82438391a56b7cda25a363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dccda1fb9a44c3d91811677bd6f36c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:03:20.426758 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-7e37db19-dc5b-4890-b84d-42ecf88f9f81 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] 10.222.0.115 "GET /compute/v2.1/servers/1ec98e47-e93b-4a79-ad3d-78e2dd1aa22a" status: 200 len: 1465 microversion: 2.1 time: 0.096774 Aug 02 11:03:20.431574 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 468/949] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:03:20 2022] GET /compute/v2.1/servers/1ec98e47-e93b-4a79-ad3d-78e2dd1aa22a => generated 1465 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:03:21.451203 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-e6b57937-7431-4d76-af0b-f4f22335007b tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:03:21.451902 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-e6b57937-7431-4d76-af0b-f4f22335007b tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] [instance: 1ec98e47-e93b-4a79-ad3d-78e2dd1aa22a] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:03:21.460563 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-e6b57937-7431-4d76-af0b-f4f22335007b tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:21.460686 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-e6b57937-7431-4d76-af0b-f4f22335007b tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:21.461485 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-e6b57937-7431-4d76-af0b-f4f22335007b tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:21.461934 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-e6b57937-7431-4d76-af0b-f4f22335007b tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:21.497630 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-e6b57937-7431-4d76-af0b-f4f22335007b tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:21.498125 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-e6b57937-7431-4d76-af0b-f4f22335007b tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:21.498575 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.objects.instance [None req-e6b57937-7431-4d76-af0b-f4f22335007b tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lazy-loading 'fault' on Instance uuid 1ec98e47-e93b-4a79-ad3d-78e2dd1aa22a {{(pid=129953) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 11:03:21.549187 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-e6b57937-7431-4d76-af0b-f4f22335007b tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ba1b5dac82438391a56b7cda25a363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dccda1fb9a44c3d91811677bd6f36c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:03:21.556143 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-e6b57937-7431-4d76-af0b-f4f22335007b tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] 10.222.0.115 "GET /compute/v2.1/servers/1ec98e47-e93b-4a79-ad3d-78e2dd1aa22a" status: 200 len: 1307 microversion: 2.1 time: 0.109859 Aug 02 11:03:21.556708 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 482/950] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:03:21 2022] GET /compute/v2.1/servers/1ec98e47-e93b-4a79-ad3d-78e2dd1aa22a => generated 1307 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:03:22.582425 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-4f42205d-7488-4ee2-bb60-f999ca2e52c6 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:03:22.583433 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-4f42205d-7488-4ee2-bb60-f999ca2e52c6 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] [instance: 1ec98e47-e93b-4a79-ad3d-78e2dd1aa22a] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:03:22.591864 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-4f42205d-7488-4ee2-bb60-f999ca2e52c6 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:22.592471 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-4f42205d-7488-4ee2-bb60-f999ca2e52c6 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:22.593695 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-4f42205d-7488-4ee2-bb60-f999ca2e52c6 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:22.594331 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-4f42205d-7488-4ee2-bb60-f999ca2e52c6 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:22.609193 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.wsgi [None req-4f42205d-7488-4ee2-bb60-f999ca2e52c6 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] HTTP exception thrown: Instance 1ec98e47-e93b-4a79-ad3d-78e2dd1aa22a could not be found. Aug 02 11:03:22.611310 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-4f42205d-7488-4ee2-bb60-f999ca2e52c6 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Request method failure captured: Aug 02 11:03:22.611310 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: request: GET /compute/v2.1/servers/1ec98e47-e93b-4a79-ad3d-78e2dd1aa22a HTTP/1.1 Aug 02 11:03:22.611310 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Accept: application/json Aug 02 11:03:22.611310 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Accept-Encoding: identity Aug 02 11:03:22.611310 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Connection: close Aug 02 11:03:22.611310 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Content-Length: 0 Aug 02 11:03:22.611310 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Content-Type: application/json Aug 02 11:03:22.611310 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Host: 10.222.0.115 Aug 02 11:03:22.611310 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Openstack-System-Scope: None Aug 02 11:03:22.611310 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: User-Agent: python-urllib3/1.26.10 Aug 02 11:03:22.611310 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Auth-Token: gAAAAABi6QRcFTCvnODZoFDRgn1-exDWbX92HOkeMkS1OEW6B_T0wWuhdJPmnElu1xrqeLrKWZloMaQaE9OvWmjh1VZaLC_QXgJ2kkZu0XqxcKdiksCyalhLvicZ0qFDgrYjLwvycBKgn9ajyQHzvl1liY-KRZi6yFhUbe8QBdp6PE1OhnFTssg Aug 02 11:03:22.611310 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Domain-Id: None Aug 02 11:03:22.611310 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Domain-Name: None Aug 02 11:03:22.611310 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Identity-Status: Confirmed Aug 02 11:03:22.611310 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Is-Admin-Project: True Aug 02 11:03:22.611310 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Project-Domain-Id: default Aug 02 11:03:22.611310 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Project-Domain-Name: Default Aug 02 11:03:22.611310 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Project-Id: 4dccda1fb9a44c3d91811677bd6f36c3 Aug 02 11:03:22.611310 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Project-Name: tempest-VolumesActionsTest-1935531505 Aug 02 11:03:22.611310 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Role: reader,member Aug 02 11:03:22.611310 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Roles: reader,member Aug 02 11:03:22.613343 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/4dccda1fb9a44c3d91811677bd6f36c3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2/4dccda1fb9a44c3d91811677bd6f36c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/4dccda1fb9a44c3d91811677bd6f36c3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.115:8080", "publicURL": "http://10.222.0.115:8080/v1/AUTH_4dccda1fb9a44c3d91811677bd6f36c3"}]}] Aug 02 11:03:22.613343 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Tenant: tempest-VolumesActionsTest-1935531505 Aug 02 11:03:22.613343 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Tenant-Id: 4dccda1fb9a44c3d91811677bd6f36c3 Aug 02 11:03:22.613343 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Tenant-Name: tempest-VolumesActionsTest-1935531505 Aug 02 11:03:22.613343 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User: tempest-VolumesActionsTest-1935531505-project Aug 02 11:03:22.613343 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User-Domain-Id: default Aug 02 11:03:22.613343 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User-Domain-Name: Default Aug 02 11:03:22.613343 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User-Id: d4ba1b5dac82438391a56b7cda25a363 Aug 02 11:03:22.613343 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User-Name: tempest-VolumesActionsTest-1935531505-project Aug 02 11:03:22.613343 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: method: > Aug 02 11:03:22.613343 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: exception: Instance 1ec98e47-e93b-4a79-ad3d-78e2dd1aa22a could not be found. Aug 02 11:03:22.613343 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: action_args: {'id': '1ec98e47-e93b-4a79-ad3d-78e2dd1aa22a'} Aug 02 11:03:22.614315 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 11:03:22.614315 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:03:22.614315 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 11:03:22.614315 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 11:03:22.614315 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 11:03:22.614315 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 11:03:22.614315 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 11:03:22.614315 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 11:03:22.614315 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 11:03:22.614315 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 11:03:22.614315 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ec98e47-e93b-4a79-ad3d-78e2dd1aa22a could not be found. Aug 02 11:03:22.614315 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 11:03:22.614315 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 11:03:22.614315 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 11:03:22.614315 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:03:22.614315 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 11:03:22.614315 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 11:03:22.614315 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 11:03:22.614315 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 11:03:22.614315 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 11:03:22.615759 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 11:03:22.615759 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 11:03:22.615759 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 11:03:22.615759 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 11:03:22.615759 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 11:03:22.615759 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 11:03:22.615759 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 11:03:22.615759 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ec98e47-e93b-4a79-ad3d-78e2dd1aa22a could not be found. Aug 02 11:03:22.615759 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 11:03:22.615759 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 11:03:22.615759 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 11:03:22.615759 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:03:22.615759 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 11:03:22.615759 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 11:03:22.615759 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 11:03:22.615759 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 11:03:22.615759 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ec98e47-e93b-4a79-ad3d-78e2dd1aa22a could not be found. Aug 02 11:03:22.615759 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 11:03:22.617369 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-4f42205d-7488-4ee2-bb60-f999ca2e52c6 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Returning 404 to user: Instance 1ec98e47-e93b-4a79-ad3d-78e2dd1aa22a could not be found. {{(pid=129952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 11:03:22.617369 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-4f42205d-7488-4ee2-bb60-f999ca2e52c6 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] 10.222.0.115 "GET /compute/v2.1/servers/1ec98e47-e93b-4a79-ad3d-78e2dd1aa22a" status: 404 len: 111 microversion: 2.1 time: 0.035290 Aug 02 11:03:22.617369 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 469/951] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:03:22 2022] GET /compute/v2.1/servers/1ec98e47-e93b-4a79-ad3d-78e2dd1aa22a => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 11:03:22.739006 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-a57fb548-6e89-4518-97cb-2833dae2c8de tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1582162050", "imageRef": "aa0a7b8c-0dd6-4803-8767-cb8c2d05fdd4", "flavorRef": "452", "networks": [{"uuid": "5c059d2f-797d-44ba-a7f6-798dc62d3140"}]}} {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 11:03:22.807227 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-6a528c9d-9804-48ea-a6cb-4f3097ca1894 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1838400271", "imageRef": "aa0a7b8c-0dd6-4803-8767-cb8c2d05fdd4", "flavorRef": "452", "networks": [{"uuid": "7deef5f7-3016-4b4c-9d6c-478898f91d61"}]}} {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 11:03:22.807920 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.network.neutron [None req-a57fb548-6e89-4518-97cb-2833dae2c8de tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] validate_networks() for [('5c059d2f-797d-44ba-a7f6-798dc62d3140', None, None, None, None, None)] {{(pid=129953) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 11:03:22.868598 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.network.neutron [None req-6a528c9d-9804-48ea-a6cb-4f3097ca1894 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] validate_networks() for [('7deef5f7-3016-4b4c-9d6c-478898f91d61', None, None, None, None, None)] {{(pid=129952) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 11:03:23.445127 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.virt.hardware [None req-a57fb548-6e89-4518-97cb-2833dae2c8de tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Flavor limits 0:0:0 {{(pid=129953) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 11:03:23.445553 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.virt.hardware [None req-a57fb548-6e89-4518-97cb-2833dae2c8de tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Image limits 0:0:0 {{(pid=129953) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 11:03:23.446017 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.virt.hardware [None req-a57fb548-6e89-4518-97cb-2833dae2c8de tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Flavor pref 0:0:0 {{(pid=129953) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 11:03:23.446422 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.virt.hardware [None req-a57fb548-6e89-4518-97cb-2833dae2c8de tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Image pref 0:0:0 {{(pid=129953) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 11:03:23.446830 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.virt.hardware [None req-a57fb548-6e89-4518-97cb-2833dae2c8de tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129953) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 11:03:23.461859 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-a57fb548-6e89-4518-97cb-2833dae2c8de tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:23.464978 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-a57fb548-6e89-4518-97cb-2833dae2c8de tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:23.464978 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-a57fb548-6e89-4518-97cb-2833dae2c8de tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:23.464978 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-a57fb548-6e89-4518-97cb-2833dae2c8de tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:23.473761 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.virt.hardware [None req-6a528c9d-9804-48ea-a6cb-4f3097ca1894 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Flavor limits 0:0:0 {{(pid=129952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 11:03:23.474542 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.virt.hardware [None req-6a528c9d-9804-48ea-a6cb-4f3097ca1894 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Image limits 0:0:0 {{(pid=129952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 11:03:23.475263 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.virt.hardware [None req-6a528c9d-9804-48ea-a6cb-4f3097ca1894 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Flavor pref 0:0:0 {{(pid=129952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 11:03:23.475677 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.virt.hardware [None req-6a528c9d-9804-48ea-a6cb-4f3097ca1894 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Image pref 0:0:0 {{(pid=129952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 11:03:23.476081 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.virt.hardware [None req-6a528c9d-9804-48ea-a6cb-4f3097ca1894 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 11:03:23.489642 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-6a528c9d-9804-48ea-a6cb-4f3097ca1894 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:23.490272 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-6a528c9d-9804-48ea-a6cb-4f3097ca1894 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:23.502011 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.quota [None req-a57fb548-6e89-4518-97cb-2833dae2c8de tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Getting quotas for project 4dccda1fb9a44c3d91811677bd6f36c3. Resources: {'instances', 'cores', 'ram'} {{(pid=129953) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 11:03:23.504718 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-6a528c9d-9804-48ea-a6cb-4f3097ca1894 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:23.505170 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-6a528c9d-9804-48ea-a6cb-4f3097ca1894 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:23.507612 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.quota [None req-a57fb548-6e89-4518-97cb-2833dae2c8de tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Getting quotas for user d4ba1b5dac82438391a56b7cda25a363 and project 4dccda1fb9a44c3d91811677bd6f36c3. Resources: {'instances', 'cores', 'ram'} {{(pid=129953) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 11:03:23.522167 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-a57fb548-6e89-4518-97cb-2833dae2c8de tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Going to run 1 instances... {{(pid=129953) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 11:03:23.524507 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-a57fb548-6e89-4518-97cb-2833dae2c8de tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] [instance: f5aba9b4-e5cb-4693-a68d-c6c244c01dab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aa0a7b8c-0dd6-4803-8767-cb8c2d05fdd4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129953) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 11:03:23.524765 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.quota [None req-6a528c9d-9804-48ea-a6cb-4f3097ca1894 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Getting quotas for project 1ebdffccaaa04484b32602a67fe23629. Resources: {'instances', 'cores', 'ram'} {{(pid=129952) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 11:03:23.529107 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.quota [None req-6a528c9d-9804-48ea-a6cb-4f3097ca1894 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Getting quotas for user 6bf80e69ea524d83ab199fc7315f4be2 and project 1ebdffccaaa04484b32602a67fe23629. Resources: {'instances', 'cores', 'ram'} {{(pid=129952) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 11:03:23.541321 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-6a528c9d-9804-48ea-a6cb-4f3097ca1894 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Going to run 1 instances... {{(pid=129952) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 11:03:23.543684 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-6a528c9d-9804-48ea-a6cb-4f3097ca1894 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] [instance: 80d311f1-c318-410a-a86b-ec44b50b40ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aa0a7b8c-0dd6-4803-8767-cb8c2d05fdd4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129952) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 11:03:23.736980 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-a57fb548-6e89-4518-97cb-2833dae2c8de tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] 10.222.0.115 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.002638 Aug 02 11:03:23.744065 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 483/952] 10.222.0.115 () {60 vars in 1152 bytes} [Tue Aug 2 11:03:22 2022] POST /compute/v2.1/servers => generated 382 bytes in 1004 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 02 11:03:23.750227 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-c5a70f1d-9acf-43ac-9db0-97a2217c26b5 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:03:23.750770 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-6a528c9d-9804-48ea-a6cb-4f3097ca1894 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] 10.222.0.115 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.947603 Aug 02 11:03:23.751515 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 470/953] 10.222.0.115 () {60 vars in 1152 bytes} [Tue Aug 2 11:03:22 2022] POST /compute/v2.1/servers => generated 382 bytes in 949 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 02 11:03:23.764534 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-5c3f345d-f8ea-4d79-b177-bce36e1c4c3b tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:03:23.766424 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-c5a70f1d-9acf-43ac-9db0-97a2217c26b5 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] [instance: f5aba9b4-e5cb-4693-a68d-c6c244c01dab] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:03:23.779767 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-5c3f345d-f8ea-4d79-b177-bce36e1c4c3b tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] [instance: 80d311f1-c318-410a-a86b-ec44b50b40ce] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:03:23.859335 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-5c3f345d-f8ea-4d79-b177-bce36e1c4c3b tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf80e69ea524d83ab199fc7315f4be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ebdffccaaa04484b32602a67fe23629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:03:23.880645 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-5c3f345d-f8ea-4d79-b177-bce36e1c4c3b tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] 10.222.0.115 "GET /compute/v2.1/servers/80d311f1-c318-410a-a86b-ec44b50b40ce" status: 200 len: 1223 microversion: 2.1 time: 0.120979 Aug 02 11:03:23.882179 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 471/954] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:03:23 2022] GET /compute/v2.1/servers/80d311f1-c318-410a-a86b-ec44b50b40ce => generated 1223 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 11:03:23.907872 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-c5a70f1d-9acf-43ac-9db0-97a2217c26b5 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ba1b5dac82438391a56b7cda25a363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dccda1fb9a44c3d91811677bd6f36c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:03:23.920376 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-c5a70f1d-9acf-43ac-9db0-97a2217c26b5 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] 10.222.0.115 "GET /compute/v2.1/servers/f5aba9b4-e5cb-4693-a68d-c6c244c01dab" status: 200 len: 1218 microversion: 2.1 time: 0.173626 Aug 02 11:03:23.920376 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 484/955] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:03:23 2022] GET /compute/v2.1/servers/f5aba9b4-e5cb-4693-a68d-c6c244c01dab => generated 1218 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:03:24.915385 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-59edbde5-3590-42b5-bae7-36eef793f808 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:03:24.916000 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-59edbde5-3590-42b5-bae7-36eef793f808 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] [instance: 80d311f1-c318-410a-a86b-ec44b50b40ce] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:03:24.943988 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-56a32a7a-265c-46e5-b1ea-751a5d5384d9 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:03:24.944773 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-56a32a7a-265c-46e5-b1ea-751a5d5384d9 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] [instance: f5aba9b4-e5cb-4693-a68d-c6c244c01dab] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:03:24.951856 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-56a32a7a-265c-46e5-b1ea-751a5d5384d9 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:24.952381 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-56a32a7a-265c-46e5-b1ea-751a5d5384d9 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:24.953229 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-56a32a7a-265c-46e5-b1ea-751a5d5384d9 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:24.953730 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-56a32a7a-265c-46e5-b1ea-751a5d5384d9 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:24.990050 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-59edbde5-3590-42b5-bae7-36eef793f808 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf80e69ea524d83ab199fc7315f4be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ebdffccaaa04484b32602a67fe23629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:03:24.997891 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-59edbde5-3590-42b5-bae7-36eef793f808 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] 10.222.0.115 "GET /compute/v2.1/servers/80d311f1-c318-410a-a86b-ec44b50b40ce" status: 200 len: 1223 microversion: 2.1 time: 0.086344 Aug 02 11:03:24.998670 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 472/956] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:03:24 2022] GET /compute/v2.1/servers/80d311f1-c318-410a-a86b-ec44b50b40ce => generated 1223 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:03:25.022386 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-56a32a7a-265c-46e5-b1ea-751a5d5384d9 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ba1b5dac82438391a56b7cda25a363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dccda1fb9a44c3d91811677bd6f36c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:03:25.030011 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-56a32a7a-265c-46e5-b1ea-751a5d5384d9 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] 10.222.0.115 "GET /compute/v2.1/servers/f5aba9b4-e5cb-4693-a68d-c6c244c01dab" status: 200 len: 1222 microversion: 2.1 time: 0.090388 Aug 02 11:03:25.036268 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 485/957] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:03:24 2022] GET /compute/v2.1/servers/f5aba9b4-e5cb-4693-a68d-c6c244c01dab => generated 1222 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 11:03:26.019352 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-87f11fa3-6811-4383-a3ca-535803232e97 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:03:26.020009 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-87f11fa3-6811-4383-a3ca-535803232e97 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] [instance: 80d311f1-c318-410a-a86b-ec44b50b40ce] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:03:26.027472 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-87f11fa3-6811-4383-a3ca-535803232e97 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:26.027923 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-87f11fa3-6811-4383-a3ca-535803232e97 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:26.028684 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-87f11fa3-6811-4383-a3ca-535803232e97 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:26.029120 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-87f11fa3-6811-4383-a3ca-535803232e97 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:26.051125 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-ad16e15b-d60d-4e60-85f4-cd9d7f3b348e tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:03:26.051740 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-ad16e15b-d60d-4e60-85f4-cd9d7f3b348e tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] [instance: f5aba9b4-e5cb-4693-a68d-c6c244c01dab] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:03:26.058064 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-ad16e15b-d60d-4e60-85f4-cd9d7f3b348e tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:26.058550 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-ad16e15b-d60d-4e60-85f4-cd9d7f3b348e tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:26.059355 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-ad16e15b-d60d-4e60-85f4-cd9d7f3b348e tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:26.059841 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-ad16e15b-d60d-4e60-85f4-cd9d7f3b348e tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:26.091738 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-87f11fa3-6811-4383-a3ca-535803232e97 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf80e69ea524d83ab199fc7315f4be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ebdffccaaa04484b32602a67fe23629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:03:26.099893 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-87f11fa3-6811-4383-a3ca-535803232e97 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] 10.222.0.115 "GET /compute/v2.1/servers/80d311f1-c318-410a-a86b-ec44b50b40ce" status: 200 len: 1275 microversion: 2.1 time: 0.085797 Aug 02 11:03:26.100670 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 473/958] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:03:26 2022] GET /compute/v2.1/servers/80d311f1-c318-410a-a86b-ec44b50b40ce => generated 1275 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:03:26.133321 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-ad16e15b-d60d-4e60-85f4-cd9d7f3b348e tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ba1b5dac82438391a56b7cda25a363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dccda1fb9a44c3d91811677bd6f36c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:03:26.141783 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-ad16e15b-d60d-4e60-85f4-cd9d7f3b348e tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] 10.222.0.115 "GET /compute/v2.1/servers/f5aba9b4-e5cb-4693-a68d-c6c244c01dab" status: 200 len: 1270 microversion: 2.1 time: 0.094595 Aug 02 11:03:26.142648 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 486/959] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:03:26 2022] GET /compute/v2.1/servers/f5aba9b4-e5cb-4693-a68d-c6c244c01dab => generated 1270 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 11:03:27.121162 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-00c01f25-5a3f-4ff9-971b-b139a269f480 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:03:27.122379 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-00c01f25-5a3f-4ff9-971b-b139a269f480 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] [instance: 80d311f1-c318-410a-a86b-ec44b50b40ce] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:03:27.130309 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-00c01f25-5a3f-4ff9-971b-b139a269f480 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:27.130760 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-00c01f25-5a3f-4ff9-971b-b139a269f480 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:27.131568 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-00c01f25-5a3f-4ff9-971b-b139a269f480 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:27.132003 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-00c01f25-5a3f-4ff9-971b-b139a269f480 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:27.164684 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-0f325e65-4257-49ca-a45e-9d5e5360e2b6 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:03:27.166017 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-0f325e65-4257-49ca-a45e-9d5e5360e2b6 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] [instance: f5aba9b4-e5cb-4693-a68d-c6c244c01dab] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:03:27.186586 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-0f325e65-4257-49ca-a45e-9d5e5360e2b6 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:27.187028 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-0f325e65-4257-49ca-a45e-9d5e5360e2b6 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:27.194372 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-0f325e65-4257-49ca-a45e-9d5e5360e2b6 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:27.194833 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-0f325e65-4257-49ca-a45e-9d5e5360e2b6 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:27.255492 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-00c01f25-5a3f-4ff9-971b-b139a269f480 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf80e69ea524d83ab199fc7315f4be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ebdffccaaa04484b32602a67fe23629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:03:27.265196 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-00c01f25-5a3f-4ff9-971b-b139a269f480 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] 10.222.0.115 "GET /compute/v2.1/servers/80d311f1-c318-410a-a86b-ec44b50b40ce" status: 200 len: 1293 microversion: 2.1 time: 0.147789 Aug 02 11:03:27.267200 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 474/960] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:03:27 2022] GET /compute/v2.1/servers/80d311f1-c318-410a-a86b-ec44b50b40ce => generated 1293 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:03:27.450556 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-0f325e65-4257-49ca-a45e-9d5e5360e2b6 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ba1b5dac82438391a56b7cda25a363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dccda1fb9a44c3d91811677bd6f36c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:03:27.458569 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-0f325e65-4257-49ca-a45e-9d5e5360e2b6 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] 10.222.0.115 "GET /compute/v2.1/servers/f5aba9b4-e5cb-4693-a68d-c6c244c01dab" status: 200 len: 1318 microversion: 2.1 time: 0.297955 Aug 02 11:03:27.467758 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 487/961] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:03:27 2022] GET /compute/v2.1/servers/f5aba9b4-e5cb-4693-a68d-c6c244c01dab => generated 1318 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 11:03:28.293281 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-c9bb49c8-2614-4710-9b1f-7abcdff0babf tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:03:28.293281 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-c9bb49c8-2614-4710-9b1f-7abcdff0babf tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] [instance: 80d311f1-c318-410a-a86b-ec44b50b40ce] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:03:28.298441 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-c9bb49c8-2614-4710-9b1f-7abcdff0babf tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:28.299549 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-c9bb49c8-2614-4710-9b1f-7abcdff0babf tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:28.300543 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-c9bb49c8-2614-4710-9b1f-7abcdff0babf tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:28.300983 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-c9bb49c8-2614-4710-9b1f-7abcdff0babf tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:28.426101 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [req-223fd97e-49ef-4d8c-810e-0478dadadb4e req-22d0c045-7b1a-4456-a3d0-a11f7b9c7f02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5aba9b4-e5cb-4693-a68d-c6c244c01dab", "tag": "88501b93-c35b-4458-a1ad-cfd46623f75b"}]} {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 11:03:28.436051 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-c9bb49c8-2614-4710-9b1f-7abcdff0babf tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf80e69ea524d83ab199fc7315f4be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ebdffccaaa04484b32602a67fe23629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:03:28.444279 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [req-223fd97e-49ef-4d8c-810e-0478dadadb4e req-22d0c045-7b1a-4456-a3d0-a11f7b9c7f02 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:28.444949 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [req-223fd97e-49ef-4d8c-810e-0478dadadb4e req-22d0c045-7b1a-4456-a3d0-a11f7b9c7f02 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:28.445428 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-c9bb49c8-2614-4710-9b1f-7abcdff0babf tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] 10.222.0.115 "GET /compute/v2.1/servers/80d311f1-c318-410a-a86b-ec44b50b40ce" status: 200 len: 1323 microversion: 2.1 time: 0.157930 Aug 02 11:03:28.446006 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 475/962] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:03:28 2022] GET /compute/v2.1/servers/80d311f1-c318-410a-a86b-ec44b50b40ce => generated 1323 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:03:28.457269 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.compute.server_external_events [req-223fd97e-49ef-4d8c-810e-0478dadadb4e req-22d0c045-7b1a-4456-a3d0-a11f7b9c7f02 service nova] Creating event network-changed:88501b93-c35b-4458-a1ad-cfd46623f75b for instance f5aba9b4-e5cb-4693-a68d-c6c244c01dab on hv-cinder-85031 Aug 02 11:03:28.462434 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [req-223fd97e-49ef-4d8c-810e-0478dadadb4e req-22d0c045-7b1a-4456-a3d0-a11f7b9c7f02 service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040851 Aug 02 11:03:28.463029 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 488/963] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Aug 2 11:03:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 11:03:28.480770 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-781c04aa-9a12-43ec-9c5e-3668a4142316 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:03:28.482305 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-781c04aa-9a12-43ec-9c5e-3668a4142316 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] [instance: f5aba9b4-e5cb-4693-a68d-c6c244c01dab] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:03:28.489653 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-781c04aa-9a12-43ec-9c5e-3668a4142316 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:28.490106 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-781c04aa-9a12-43ec-9c5e-3668a4142316 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:28.490909 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-781c04aa-9a12-43ec-9c5e-3668a4142316 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:28.491377 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-781c04aa-9a12-43ec-9c5e-3668a4142316 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:28.621078 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-781c04aa-9a12-43ec-9c5e-3668a4142316 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ba1b5dac82438391a56b7cda25a363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dccda1fb9a44c3d91811677bd6f36c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:03:28.628838 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-781c04aa-9a12-43ec-9c5e-3668a4142316 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] 10.222.0.115 "GET /compute/v2.1/servers/f5aba9b4-e5cb-4693-a68d-c6c244c01dab" status: 200 len: 1318 microversion: 2.1 time: 0.152104 Aug 02 11:03:28.629392 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 476/964] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:03:28 2022] GET /compute/v2.1/servers/f5aba9b4-e5cb-4693-a68d-c6c244c01dab => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:03:29.467143 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-3e65695d-4ef0-4376-acf8-fdccce62897e tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:03:29.467843 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-3e65695d-4ef0-4376-acf8-fdccce62897e tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] [instance: 80d311f1-c318-410a-a86b-ec44b50b40ce] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:03:29.474707 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-3e65695d-4ef0-4376-acf8-fdccce62897e tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:29.475198 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-3e65695d-4ef0-4376-acf8-fdccce62897e tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:29.475956 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-3e65695d-4ef0-4376-acf8-fdccce62897e tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:29.476391 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-3e65695d-4ef0-4376-acf8-fdccce62897e tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:29.611653 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-3e65695d-4ef0-4376-acf8-fdccce62897e tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf80e69ea524d83ab199fc7315f4be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ebdffccaaa04484b32602a67fe23629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:03:29.619913 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-3e65695d-4ef0-4376-acf8-fdccce62897e tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] 10.222.0.115 "GET /compute/v2.1/servers/80d311f1-c318-410a-a86b-ec44b50b40ce" status: 200 len: 1323 microversion: 2.1 time: 0.157361 Aug 02 11:03:29.620491 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 489/965] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:03:29 2022] GET /compute/v2.1/servers/80d311f1-c318-410a-a86b-ec44b50b40ce => generated 1323 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:03:29.650899 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-be2b3f53-5dd1-4867-8ada-5251ca7a46a5 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:03:29.651591 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-be2b3f53-5dd1-4867-8ada-5251ca7a46a5 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] [instance: f5aba9b4-e5cb-4693-a68d-c6c244c01dab] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:03:29.659277 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-be2b3f53-5dd1-4867-8ada-5251ca7a46a5 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:29.659469 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-be2b3f53-5dd1-4867-8ada-5251ca7a46a5 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:29.660264 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-be2b3f53-5dd1-4867-8ada-5251ca7a46a5 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:29.660778 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-be2b3f53-5dd1-4867-8ada-5251ca7a46a5 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:29.793959 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-be2b3f53-5dd1-4867-8ada-5251ca7a46a5 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ba1b5dac82438391a56b7cda25a363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dccda1fb9a44c3d91811677bd6f36c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:03:29.802232 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-be2b3f53-5dd1-4867-8ada-5251ca7a46a5 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] 10.222.0.115 "GET /compute/v2.1/servers/f5aba9b4-e5cb-4693-a68d-c6c244c01dab" status: 200 len: 1318 microversion: 2.1 time: 0.156329 Aug 02 11:03:29.802961 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 477/966] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:03:29 2022] GET /compute/v2.1/servers/f5aba9b4-e5cb-4693-a68d-c6c244c01dab => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:03:30.640911 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-fb22ab18-1a2b-44e4-b930-0503710f8444 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:03:30.641516 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-fb22ab18-1a2b-44e4-b930-0503710f8444 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] [instance: 80d311f1-c318-410a-a86b-ec44b50b40ce] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:03:30.648415 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-fb22ab18-1a2b-44e4-b930-0503710f8444 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:30.648855 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-fb22ab18-1a2b-44e4-b930-0503710f8444 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:30.649604 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-fb22ab18-1a2b-44e4-b930-0503710f8444 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:30.650032 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-fb22ab18-1a2b-44e4-b930-0503710f8444 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:30.777510 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-fb22ab18-1a2b-44e4-b930-0503710f8444 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf80e69ea524d83ab199fc7315f4be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ebdffccaaa04484b32602a67fe23629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:03:30.785504 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-fb22ab18-1a2b-44e4-b930-0503710f8444 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] 10.222.0.115 "GET /compute/v2.1/servers/80d311f1-c318-410a-a86b-ec44b50b40ce" status: 200 len: 1323 microversion: 2.1 time: 0.148455 Aug 02 11:03:30.786062 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 490/967] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:03:30 2022] GET /compute/v2.1/servers/80d311f1-c318-410a-a86b-ec44b50b40ce => generated 1323 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:03:30.823394 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-53d12371-53a4-4ab2-80a4-09dac7cbcbf3 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:03:30.824019 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-53d12371-53a4-4ab2-80a4-09dac7cbcbf3 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] [instance: f5aba9b4-e5cb-4693-a68d-c6c244c01dab] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:03:30.831269 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-53d12371-53a4-4ab2-80a4-09dac7cbcbf3 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:30.831752 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-53d12371-53a4-4ab2-80a4-09dac7cbcbf3 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:30.832718 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-53d12371-53a4-4ab2-80a4-09dac7cbcbf3 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:30.833145 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-53d12371-53a4-4ab2-80a4-09dac7cbcbf3 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:30.852344 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG dbcounter [-] [129952] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 11:03:31.015922 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-53d12371-53a4-4ab2-80a4-09dac7cbcbf3 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ba1b5dac82438391a56b7cda25a363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dccda1fb9a44c3d91811677bd6f36c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:03:31.025033 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-53d12371-53a4-4ab2-80a4-09dac7cbcbf3 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] 10.222.0.115 "GET /compute/v2.1/servers/f5aba9b4-e5cb-4693-a68d-c6c244c01dab" status: 200 len: 1318 microversion: 2.1 time: 0.205692 Aug 02 11:03:31.039083 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 478/968] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:03:30 2022] GET /compute/v2.1/servers/f5aba9b4-e5cb-4693-a68d-c6c244c01dab => generated 1318 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:03:31.650041 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [req-816c97e7-b8d9-4bbe-941a-a127c2f2de9e req-8a633c00-6ce3-4ad2-b857-ae85ffc1c8e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80d311f1-c318-410a-a86b-ec44b50b40ce", "tag": "c7069fe9-8652-4b41-ac2d-e70961003bff"}]} {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 11:03:31.661242 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [req-816c97e7-b8d9-4bbe-941a-a127c2f2de9e req-8a633c00-6ce3-4ad2-b857-ae85ffc1c8e5 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:31.661697 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [req-816c97e7-b8d9-4bbe-941a-a127c2f2de9e req-8a633c00-6ce3-4ad2-b857-ae85ffc1c8e5 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:31.672855 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.compute.server_external_events [req-816c97e7-b8d9-4bbe-941a-a127c2f2de9e req-8a633c00-6ce3-4ad2-b857-ae85ffc1c8e5 service nova] Creating event network-changed:c7069fe9-8652-4b41-ac2d-e70961003bff for instance 80d311f1-c318-410a-a86b-ec44b50b40ce on hv-cinder-85031 Aug 02 11:03:31.678340 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [req-816c97e7-b8d9-4bbe-941a-a127c2f2de9e req-8a633c00-6ce3-4ad2-b857-ae85ffc1c8e5 service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032664 Aug 02 11:03:31.678945 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 491/969] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Aug 2 11:03:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 11:03:31.806013 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-5c06cfdc-1a3a-48ab-91aa-b7dc2348d14b tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:03:31.806620 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-5c06cfdc-1a3a-48ab-91aa-b7dc2348d14b tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] [instance: 80d311f1-c318-410a-a86b-ec44b50b40ce] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:03:31.812679 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-5c06cfdc-1a3a-48ab-91aa-b7dc2348d14b tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:31.813126 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-5c06cfdc-1a3a-48ab-91aa-b7dc2348d14b tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:31.813926 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-5c06cfdc-1a3a-48ab-91aa-b7dc2348d14b tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:31.814933 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-5c06cfdc-1a3a-48ab-91aa-b7dc2348d14b tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:31.948932 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-5c06cfdc-1a3a-48ab-91aa-b7dc2348d14b tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf80e69ea524d83ab199fc7315f4be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ebdffccaaa04484b32602a67fe23629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:03:31.956931 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-5c06cfdc-1a3a-48ab-91aa-b7dc2348d14b tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] 10.222.0.115 "GET /compute/v2.1/servers/80d311f1-c318-410a-a86b-ec44b50b40ce" status: 200 len: 1323 microversion: 2.1 time: 0.154827 Aug 02 11:03:31.957498 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 479/970] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:03:31 2022] GET /compute/v2.1/servers/80d311f1-c318-410a-a86b-ec44b50b40ce => generated 1323 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:03:32.046225 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-845accb6-e91a-4c15-871e-ffd9abc0498a tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:03:32.046915 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-845accb6-e91a-4c15-871e-ffd9abc0498a tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] [instance: f5aba9b4-e5cb-4693-a68d-c6c244c01dab] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:03:32.053888 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-845accb6-e91a-4c15-871e-ffd9abc0498a tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:32.054337 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-845accb6-e91a-4c15-871e-ffd9abc0498a tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:32.055120 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-845accb6-e91a-4c15-871e-ffd9abc0498a tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:32.055555 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-845accb6-e91a-4c15-871e-ffd9abc0498a tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:32.183837 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-845accb6-e91a-4c15-871e-ffd9abc0498a tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ba1b5dac82438391a56b7cda25a363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dccda1fb9a44c3d91811677bd6f36c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:03:32.191594 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-845accb6-e91a-4c15-871e-ffd9abc0498a tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] 10.222.0.115 "GET /compute/v2.1/servers/f5aba9b4-e5cb-4693-a68d-c6c244c01dab" status: 200 len: 1318 microversion: 2.1 time: 0.149581 Aug 02 11:03:32.192159 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 492/971] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:03:32 2022] GET /compute/v2.1/servers/f5aba9b4-e5cb-4693-a68d-c6c244c01dab => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:03:32.979181 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-c69fb9d8-9b9e-4596-a9aa-c970c322da4a tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:03:32.979799 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-c69fb9d8-9b9e-4596-a9aa-c970c322da4a tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] [instance: 80d311f1-c318-410a-a86b-ec44b50b40ce] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:03:32.988109 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-c69fb9d8-9b9e-4596-a9aa-c970c322da4a tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:32.988571 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-c69fb9d8-9b9e-4596-a9aa-c970c322da4a tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:32.989360 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-c69fb9d8-9b9e-4596-a9aa-c970c322da4a tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:32.989976 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-c69fb9d8-9b9e-4596-a9aa-c970c322da4a tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:33.212214 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-cbd6456b-c2dd-4c63-bd0f-ffc37f0b2798 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:03:33.212820 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-cbd6456b-c2dd-4c63-bd0f-ffc37f0b2798 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] [instance: f5aba9b4-e5cb-4693-a68d-c6c244c01dab] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:03:33.213996 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-c69fb9d8-9b9e-4596-a9aa-c970c322da4a tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf80e69ea524d83ab199fc7315f4be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ebdffccaaa04484b32602a67fe23629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:03:33.219311 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-cbd6456b-c2dd-4c63-bd0f-ffc37f0b2798 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:33.219758 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-cbd6456b-c2dd-4c63-bd0f-ffc37f0b2798 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:33.220665 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-cbd6456b-c2dd-4c63-bd0f-ffc37f0b2798 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:33.221102 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-cbd6456b-c2dd-4c63-bd0f-ffc37f0b2798 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:33.224692 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-c69fb9d8-9b9e-4596-a9aa-c970c322da4a tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] 10.222.0.115 "GET /compute/v2.1/servers/80d311f1-c318-410a-a86b-ec44b50b40ce" status: 200 len: 1323 microversion: 2.1 time: 0.249498 Aug 02 11:03:33.225277 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 480/972] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:03:32 2022] GET /compute/v2.1/servers/80d311f1-c318-410a-a86b-ec44b50b40ce => generated 1323 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:03:33.423650 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-cbd6456b-c2dd-4c63-bd0f-ffc37f0b2798 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ba1b5dac82438391a56b7cda25a363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dccda1fb9a44c3d91811677bd6f36c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:03:33.431989 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-cbd6456b-c2dd-4c63-bd0f-ffc37f0b2798 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] 10.222.0.115 "GET /compute/v2.1/servers/f5aba9b4-e5cb-4693-a68d-c6c244c01dab" status: 200 len: 1318 microversion: 2.1 time: 0.223667 Aug 02 11:03:33.432770 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 493/973] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:03:33 2022] GET /compute/v2.1/servers/f5aba9b4-e5cb-4693-a68d-c6c244c01dab => generated 1318 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 11:03:34.245880 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-d5024c71-9182-4163-8ca2-614b92c784d2 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:03:34.246429 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-d5024c71-9182-4163-8ca2-614b92c784d2 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] [instance: 80d311f1-c318-410a-a86b-ec44b50b40ce] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:03:34.249284 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG dbcounter [-] [129952] Writing DB stats nova_cell0:SELECT=2 {{(pid=129952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 11:03:34.253975 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-d5024c71-9182-4163-8ca2-614b92c784d2 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:34.254418 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-d5024c71-9182-4163-8ca2-614b92c784d2 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:34.255207 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-d5024c71-9182-4163-8ca2-614b92c784d2 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:34.255640 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-d5024c71-9182-4163-8ca2-614b92c784d2 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:34.390131 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-d5024c71-9182-4163-8ca2-614b92c784d2 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf80e69ea524d83ab199fc7315f4be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ebdffccaaa04484b32602a67fe23629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:03:34.398374 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-d5024c71-9182-4163-8ca2-614b92c784d2 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] 10.222.0.115 "GET /compute/v2.1/servers/80d311f1-c318-410a-a86b-ec44b50b40ce" status: 200 len: 1323 microversion: 2.1 time: 0.156466 Aug 02 11:03:34.398928 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 481/974] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:03:34 2022] GET /compute/v2.1/servers/80d311f1-c318-410a-a86b-ec44b50b40ce => generated 1323 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:03:34.452902 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-be60039c-621c-467d-8a9d-3b06d8e1d634 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:03:34.453511 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-be60039c-621c-467d-8a9d-3b06d8e1d634 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] [instance: f5aba9b4-e5cb-4693-a68d-c6c244c01dab] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:03:34.457046 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG dbcounter [-] [129953] Writing DB stats nova_cell0:SELECT=2 {{(pid=129953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 11:03:34.457762 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG dbcounter [-] [129953] Writing DB stats nova_cell0:SELECT=8 {{(pid=129953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 11:03:34.463606 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-be60039c-621c-467d-8a9d-3b06d8e1d634 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:34.464047 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-be60039c-621c-467d-8a9d-3b06d8e1d634 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:34.464815 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-be60039c-621c-467d-8a9d-3b06d8e1d634 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:34.465256 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-be60039c-621c-467d-8a9d-3b06d8e1d634 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:34.483491 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG dbcounter [-] [129953] Writing DB stats nova_cell1:SELECT=100 {{(pid=129953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 11:03:34.606190 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-be60039c-621c-467d-8a9d-3b06d8e1d634 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ba1b5dac82438391a56b7cda25a363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dccda1fb9a44c3d91811677bd6f36c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:03:34.637476 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-be60039c-621c-467d-8a9d-3b06d8e1d634 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] 10.222.0.115 "GET /compute/v2.1/servers/f5aba9b4-e5cb-4693-a68d-c6c244c01dab" status: 200 len: 1318 microversion: 2.1 time: 0.166019 Aug 02 11:03:34.637476 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 494/975] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:03:34 2022] GET /compute/v2.1/servers/f5aba9b4-e5cb-4693-a68d-c6c244c01dab => generated 1318 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:03:35.419295 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-30c1f666-b2e6-4ff8-8654-4d19f94a9bdc tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:03:35.419925 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-30c1f666-b2e6-4ff8-8654-4d19f94a9bdc tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] [instance: 80d311f1-c318-410a-a86b-ec44b50b40ce] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:03:35.421735 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG dbcounter [-] [129952] Writing DB stats nova_cell0:SELECT=10 {{(pid=129952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 11:03:35.427695 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-30c1f666-b2e6-4ff8-8654-4d19f94a9bdc tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:35.428105 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-30c1f666-b2e6-4ff8-8654-4d19f94a9bdc tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:35.428867 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-30c1f666-b2e6-4ff8-8654-4d19f94a9bdc tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:35.429301 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-30c1f666-b2e6-4ff8-8654-4d19f94a9bdc tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:35.633911 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-30c1f666-b2e6-4ff8-8654-4d19f94a9bdc tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf80e69ea524d83ab199fc7315f4be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ebdffccaaa04484b32602a67fe23629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:03:35.637575 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-857ff417-fa7b-40b6-966c-4db1678c25c7 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:03:35.638241 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-857ff417-fa7b-40b6-966c-4db1678c25c7 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] [instance: f5aba9b4-e5cb-4693-a68d-c6c244c01dab] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:03:35.642392 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-30c1f666-b2e6-4ff8-8654-4d19f94a9bdc tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] 10.222.0.115 "GET /compute/v2.1/servers/80d311f1-c318-410a-a86b-ec44b50b40ce" status: 200 len: 1323 microversion: 2.1 time: 0.226983 Aug 02 11:03:35.643380 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 482/976] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:03:35 2022] GET /compute/v2.1/servers/80d311f1-c318-410a-a86b-ec44b50b40ce => generated 1323 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:03:35.645181 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-857ff417-fa7b-40b6-966c-4db1678c25c7 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:35.645627 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-857ff417-fa7b-40b6-966c-4db1678c25c7 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:35.646648 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-857ff417-fa7b-40b6-966c-4db1678c25c7 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:35.647093 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-857ff417-fa7b-40b6-966c-4db1678c25c7 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:35.785833 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-857ff417-fa7b-40b6-966c-4db1678c25c7 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ba1b5dac82438391a56b7cda25a363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dccda1fb9a44c3d91811677bd6f36c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:03:35.793815 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-857ff417-fa7b-40b6-966c-4db1678c25c7 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] 10.222.0.115 "GET /compute/v2.1/servers/f5aba9b4-e5cb-4693-a68d-c6c244c01dab" status: 200 len: 1318 microversion: 2.1 time: 0.159929 Aug 02 11:03:35.794645 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 495/977] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:03:35 2022] GET /compute/v2.1/servers/f5aba9b4-e5cb-4693-a68d-c6c244c01dab => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 11:03:36.663339 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-c7179fb7-a276-4cb2-8226-360bcf368693 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:03:36.664000 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-c7179fb7-a276-4cb2-8226-360bcf368693 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] [instance: 80d311f1-c318-410a-a86b-ec44b50b40ce] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:03:36.670348 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-c7179fb7-a276-4cb2-8226-360bcf368693 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:36.670801 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-c7179fb7-a276-4cb2-8226-360bcf368693 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:36.671606 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-c7179fb7-a276-4cb2-8226-360bcf368693 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:36.672047 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-c7179fb7-a276-4cb2-8226-360bcf368693 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:36.811552 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-c7179fb7-a276-4cb2-8226-360bcf368693 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf80e69ea524d83ab199fc7315f4be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ebdffccaaa04484b32602a67fe23629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:03:36.817263 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-3d05b6fe-e5b2-41b7-b971-9b47c051b08b tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:03:36.817826 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-3d05b6fe-e5b2-41b7-b971-9b47c051b08b tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] [instance: f5aba9b4-e5cb-4693-a68d-c6c244c01dab] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:03:36.821940 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-c7179fb7-a276-4cb2-8226-360bcf368693 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] 10.222.0.115 "GET /compute/v2.1/servers/80d311f1-c318-410a-a86b-ec44b50b40ce" status: 200 len: 1323 microversion: 2.1 time: 0.162525 Aug 02 11:03:36.825526 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 483/978] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:03:36 2022] GET /compute/v2.1/servers/80d311f1-c318-410a-a86b-ec44b50b40ce => generated 1323 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:03:36.825656 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-3d05b6fe-e5b2-41b7-b971-9b47c051b08b tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:36.825656 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-3d05b6fe-e5b2-41b7-b971-9b47c051b08b tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:36.825862 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-3d05b6fe-e5b2-41b7-b971-9b47c051b08b tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:36.826266 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-3d05b6fe-e5b2-41b7-b971-9b47c051b08b tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:36.977133 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-3d05b6fe-e5b2-41b7-b971-9b47c051b08b tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ba1b5dac82438391a56b7cda25a363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dccda1fb9a44c3d91811677bd6f36c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:03:36.984644 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-3d05b6fe-e5b2-41b7-b971-9b47c051b08b tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] 10.222.0.115 "GET /compute/v2.1/servers/f5aba9b4-e5cb-4693-a68d-c6c244c01dab" status: 200 len: 1318 microversion: 2.1 time: 0.172232 Aug 02 11:03:36.985214 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 496/979] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:03:36 2022] GET /compute/v2.1/servers/f5aba9b4-e5cb-4693-a68d-c6c244c01dab => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 11:03:37.844608 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-52d4273c-8e5b-4a04-bdf4-f8832ade155e tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:03:37.845832 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-52d4273c-8e5b-4a04-bdf4-f8832ade155e tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] [instance: 80d311f1-c318-410a-a86b-ec44b50b40ce] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:03:37.852543 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-52d4273c-8e5b-4a04-bdf4-f8832ade155e tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:37.852995 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-52d4273c-8e5b-4a04-bdf4-f8832ade155e tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:37.853756 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-52d4273c-8e5b-4a04-bdf4-f8832ade155e tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:37.854187 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-52d4273c-8e5b-4a04-bdf4-f8832ade155e tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:37.995487 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-52d4273c-8e5b-4a04-bdf4-f8832ade155e tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf80e69ea524d83ab199fc7315f4be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ebdffccaaa04484b32602a67fe23629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:03:38.003768 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-52d4273c-8e5b-4a04-bdf4-f8832ade155e tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] 10.222.0.115 "GET /compute/v2.1/servers/80d311f1-c318-410a-a86b-ec44b50b40ce" status: 200 len: 1323 microversion: 2.1 time: 0.162995 Aug 02 11:03:38.004336 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 484/980] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:03:37 2022] GET /compute/v2.1/servers/80d311f1-c318-410a-a86b-ec44b50b40ce => generated 1323 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:03:38.006540 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-d4c7cb5c-fa88-4609-8602-276a84fcd488 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:03:38.007196 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-d4c7cb5c-fa88-4609-8602-276a84fcd488 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] [instance: f5aba9b4-e5cb-4693-a68d-c6c244c01dab] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:03:38.022473 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-d4c7cb5c-fa88-4609-8602-276a84fcd488 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:38.022926 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-d4c7cb5c-fa88-4609-8602-276a84fcd488 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:38.023757 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-d4c7cb5c-fa88-4609-8602-276a84fcd488 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:38.024202 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-d4c7cb5c-fa88-4609-8602-276a84fcd488 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:38.158648 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-d4c7cb5c-fa88-4609-8602-276a84fcd488 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ba1b5dac82438391a56b7cda25a363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dccda1fb9a44c3d91811677bd6f36c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:03:38.166099 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-d4c7cb5c-fa88-4609-8602-276a84fcd488 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] 10.222.0.115 "GET /compute/v2.1/servers/f5aba9b4-e5cb-4693-a68d-c6c244c01dab" status: 200 len: 1318 microversion: 2.1 time: 0.164280 Aug 02 11:03:38.166665 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 497/981] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:03:38 2022] GET /compute/v2.1/servers/f5aba9b4-e5cb-4693-a68d-c6c244c01dab => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:03:39.024911 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-1f2ac429-4aa7-4887-95e0-e0ad7446b28d tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:03:39.025684 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-1f2ac429-4aa7-4887-95e0-e0ad7446b28d tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] [instance: 80d311f1-c318-410a-a86b-ec44b50b40ce] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:03:39.032808 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-1f2ac429-4aa7-4887-95e0-e0ad7446b28d tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:39.033462 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-1f2ac429-4aa7-4887-95e0-e0ad7446b28d tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:39.034468 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-1f2ac429-4aa7-4887-95e0-e0ad7446b28d tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:39.034904 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-1f2ac429-4aa7-4887-95e0-e0ad7446b28d tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:39.180011 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-1f2ac429-4aa7-4887-95e0-e0ad7446b28d tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf80e69ea524d83ab199fc7315f4be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ebdffccaaa04484b32602a67fe23629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:03:39.187890 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-0c7701dd-1eb5-4090-ad1b-c0f482fdb985 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:03:39.188468 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-1f2ac429-4aa7-4887-95e0-e0ad7446b28d tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] 10.222.0.115 "GET /compute/v2.1/servers/80d311f1-c318-410a-a86b-ec44b50b40ce" status: 200 len: 1323 microversion: 2.1 time: 0.167193 Aug 02 11:03:39.188957 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-0c7701dd-1eb5-4090-ad1b-c0f482fdb985 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] [instance: f5aba9b4-e5cb-4693-a68d-c6c244c01dab] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:03:39.196533 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-0c7701dd-1eb5-4090-ad1b-c0f482fdb985 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:39.200113 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-0c7701dd-1eb5-4090-ad1b-c0f482fdb985 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:39.200113 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-0c7701dd-1eb5-4090-ad1b-c0f482fdb985 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:39.200113 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-0c7701dd-1eb5-4090-ad1b-c0f482fdb985 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:39.202055 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 485/982] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:03:39 2022] GET /compute/v2.1/servers/80d311f1-c318-410a-a86b-ec44b50b40ce => generated 1323 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:03:39.335464 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [req-f46d3d3c-2abb-4a72-8a86-5471dfd64fe7 req-c68f4b32-6e45-4e8f-81c1-136266946142 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5aba9b4-e5cb-4693-a68d-c6c244c01dab", "name": "network-vif-plugged", "status": "completed", "tag": "88501b93-c35b-4458-a1ad-cfd46623f75b"}]} {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 11:03:39.346217 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [req-f46d3d3c-2abb-4a72-8a86-5471dfd64fe7 req-c68f4b32-6e45-4e8f-81c1-136266946142 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:39.347186 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [req-f46d3d3c-2abb-4a72-8a86-5471dfd64fe7 req-c68f4b32-6e45-4e8f-81c1-136266946142 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:39.349254 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-0c7701dd-1eb5-4090-ad1b-c0f482fdb985 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ba1b5dac82438391a56b7cda25a363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dccda1fb9a44c3d91811677bd6f36c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:03:39.358808 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.compute.server_external_events [req-f46d3d3c-2abb-4a72-8a86-5471dfd64fe7 req-c68f4b32-6e45-4e8f-81c1-136266946142 service nova] Creating event network-vif-plugged:88501b93-c35b-4458-a1ad-cfd46623f75b for instance f5aba9b4-e5cb-4693-a68d-c6c244c01dab on hv-cinder-85031 Aug 02 11:03:39.371210 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-0c7701dd-1eb5-4090-ad1b-c0f482fdb985 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] 10.222.0.115 "GET /compute/v2.1/servers/f5aba9b4-e5cb-4693-a68d-c6c244c01dab" status: 200 len: 1318 microversion: 2.1 time: 0.175297 Aug 02 11:03:39.371210 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 498/983] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:03:39 2022] GET /compute/v2.1/servers/f5aba9b4-e5cb-4693-a68d-c6c244c01dab => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 11:03:39.372901 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [req-f46d3d3c-2abb-4a72-8a86-5471dfd64fe7 req-c68f4b32-6e45-4e8f-81c1-136266946142 service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032338 Aug 02 11:03:39.372901 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 486/984] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Aug 2 11:03:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 11:03:40.210201 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-73b2e731-0af1-470d-9990-5b97b1b83a44 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:03:40.210808 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-73b2e731-0af1-470d-9990-5b97b1b83a44 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] [instance: 80d311f1-c318-410a-a86b-ec44b50b40ce] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:03:40.217489 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-73b2e731-0af1-470d-9990-5b97b1b83a44 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:40.217931 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-73b2e731-0af1-470d-9990-5b97b1b83a44 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:40.218694 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-73b2e731-0af1-470d-9990-5b97b1b83a44 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:40.219168 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-73b2e731-0af1-470d-9990-5b97b1b83a44 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:40.358589 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-73b2e731-0af1-470d-9990-5b97b1b83a44 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf80e69ea524d83ab199fc7315f4be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ebdffccaaa04484b32602a67fe23629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:03:40.366242 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-73b2e731-0af1-470d-9990-5b97b1b83a44 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] 10.222.0.115 "GET /compute/v2.1/servers/80d311f1-c318-410a-a86b-ec44b50b40ce" status: 200 len: 1323 microversion: 2.1 time: 0.160014 Aug 02 11:03:40.368558 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 499/985] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:03:40 2022] GET /compute/v2.1/servers/80d311f1-c318-410a-a86b-ec44b50b40ce => generated 1323 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:03:40.383267 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-db1ba10a-01be-4349-bdfc-834276805cdb tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:03:40.384024 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-db1ba10a-01be-4349-bdfc-834276805cdb tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] [instance: f5aba9b4-e5cb-4693-a68d-c6c244c01dab] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:03:40.390466 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-db1ba10a-01be-4349-bdfc-834276805cdb tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:40.391102 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-db1ba10a-01be-4349-bdfc-834276805cdb tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:40.396227 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-db1ba10a-01be-4349-bdfc-834276805cdb tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:40.396227 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-db1ba10a-01be-4349-bdfc-834276805cdb tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:40.528863 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-db1ba10a-01be-4349-bdfc-834276805cdb tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ba1b5dac82438391a56b7cda25a363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dccda1fb9a44c3d91811677bd6f36c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:03:40.536451 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-db1ba10a-01be-4349-bdfc-834276805cdb tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] 10.222.0.115 "GET /compute/v2.1/servers/f5aba9b4-e5cb-4693-a68d-c6c244c01dab" status: 200 len: 1318 microversion: 2.1 time: 0.158006 Aug 02 11:03:40.537021 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 487/986] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:03:40 2022] GET /compute/v2.1/servers/f5aba9b4-e5cb-4693-a68d-c6c244c01dab => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:03:41.390425 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-7f6fcc49-3f53-43ba-ad39-9e54fec63d54 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:03:41.391068 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-7f6fcc49-3f53-43ba-ad39-9e54fec63d54 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] [instance: 80d311f1-c318-410a-a86b-ec44b50b40ce] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:03:41.399106 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-7f6fcc49-3f53-43ba-ad39-9e54fec63d54 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:41.403195 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-7f6fcc49-3f53-43ba-ad39-9e54fec63d54 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:41.404100 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-7f6fcc49-3f53-43ba-ad39-9e54fec63d54 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:41.404588 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-7f6fcc49-3f53-43ba-ad39-9e54fec63d54 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:41.534892 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-7f6fcc49-3f53-43ba-ad39-9e54fec63d54 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf80e69ea524d83ab199fc7315f4be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ebdffccaaa04484b32602a67fe23629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:03:41.542276 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-7f6fcc49-3f53-43ba-ad39-9e54fec63d54 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] 10.222.0.115 "GET /compute/v2.1/servers/80d311f1-c318-410a-a86b-ec44b50b40ce" status: 200 len: 1323 microversion: 2.1 time: 0.157774 Aug 02 11:03:41.542840 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 500/987] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:03:41 2022] GET /compute/v2.1/servers/80d311f1-c318-410a-a86b-ec44b50b40ce => generated 1323 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:03:41.557512 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-57cfdd00-1f1f-4eff-a51a-22f5bba758a1 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:03:41.558124 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-57cfdd00-1f1f-4eff-a51a-22f5bba758a1 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] [instance: f5aba9b4-e5cb-4693-a68d-c6c244c01dab] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:03:41.564655 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-57cfdd00-1f1f-4eff-a51a-22f5bba758a1 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:41.565101 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-57cfdd00-1f1f-4eff-a51a-22f5bba758a1 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:41.565869 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-57cfdd00-1f1f-4eff-a51a-22f5bba758a1 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:41.566423 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-57cfdd00-1f1f-4eff-a51a-22f5bba758a1 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:41.701134 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-57cfdd00-1f1f-4eff-a51a-22f5bba758a1 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ba1b5dac82438391a56b7cda25a363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dccda1fb9a44c3d91811677bd6f36c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:03:41.709483 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-57cfdd00-1f1f-4eff-a51a-22f5bba758a1 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] 10.222.0.115 "GET /compute/v2.1/servers/f5aba9b4-e5cb-4693-a68d-c6c244c01dab" status: 200 len: 1318 microversion: 2.1 time: 0.155684 Aug 02 11:03:41.710078 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 488/988] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:03:41 2022] GET /compute/v2.1/servers/f5aba9b4-e5cb-4693-a68d-c6c244c01dab => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:03:41.787318 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [req-08acfef5-17c8-4d1e-9b64-a2aed4a99ea2 req-c007b8f3-30c7-474f-b65e-ba1f98bafa99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80d311f1-c318-410a-a86b-ec44b50b40ce", "name": "network-vif-plugged", "status": "completed", "tag": "c7069fe9-8652-4b41-ac2d-e70961003bff"}]} {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 11:03:41.797094 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [req-08acfef5-17c8-4d1e-9b64-a2aed4a99ea2 req-c007b8f3-30c7-474f-b65e-ba1f98bafa99 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:41.797535 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [req-08acfef5-17c8-4d1e-9b64-a2aed4a99ea2 req-c007b8f3-30c7-474f-b65e-ba1f98bafa99 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:41.808821 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.compute.server_external_events [req-08acfef5-17c8-4d1e-9b64-a2aed4a99ea2 req-c007b8f3-30c7-474f-b65e-ba1f98bafa99 service nova] Creating event network-vif-plugged:c7069fe9-8652-4b41-ac2d-e70961003bff for instance 80d311f1-c318-410a-a86b-ec44b50b40ce on hv-cinder-85031 Aug 02 11:03:41.814368 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [req-08acfef5-17c8-4d1e-9b64-a2aed4a99ea2 req-c007b8f3-30c7-474f-b65e-ba1f98bafa99 service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030697 Aug 02 11:03:41.814961 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 501/989] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Aug 2 11:03:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 11:03:42.562361 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-32f29c8e-a2de-4211-b01b-b143af00d2ff tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:03:42.562960 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-32f29c8e-a2de-4211-b01b-b143af00d2ff tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] [instance: 80d311f1-c318-410a-a86b-ec44b50b40ce] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:03:42.569910 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-32f29c8e-a2de-4211-b01b-b143af00d2ff tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:42.570351 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-32f29c8e-a2de-4211-b01b-b143af00d2ff tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:42.571136 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-32f29c8e-a2de-4211-b01b-b143af00d2ff tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:42.571623 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-32f29c8e-a2de-4211-b01b-b143af00d2ff tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:42.700977 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-32f29c8e-a2de-4211-b01b-b143af00d2ff tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf80e69ea524d83ab199fc7315f4be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ebdffccaaa04484b32602a67fe23629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:03:42.708509 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-32f29c8e-a2de-4211-b01b-b143af00d2ff tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] 10.222.0.115 "GET /compute/v2.1/servers/80d311f1-c318-410a-a86b-ec44b50b40ce" status: 200 len: 1323 microversion: 2.1 time: 0.150007 Aug 02 11:03:42.709074 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 489/990] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:03:42 2022] GET /compute/v2.1/servers/80d311f1-c318-410a-a86b-ec44b50b40ce => generated 1323 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:03:42.730560 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-f661070c-66cd-404a-a3dd-39a26a8027e0 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:03:42.731305 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-f661070c-66cd-404a-a3dd-39a26a8027e0 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] [instance: f5aba9b4-e5cb-4693-a68d-c6c244c01dab] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:03:42.738723 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-f661070c-66cd-404a-a3dd-39a26a8027e0 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:42.739215 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-f661070c-66cd-404a-a3dd-39a26a8027e0 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:42.739980 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-f661070c-66cd-404a-a3dd-39a26a8027e0 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:42.740418 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-f661070c-66cd-404a-a3dd-39a26a8027e0 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:42.872957 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-f661070c-66cd-404a-a3dd-39a26a8027e0 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ba1b5dac82438391a56b7cda25a363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dccda1fb9a44c3d91811677bd6f36c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:03:42.880622 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-f661070c-66cd-404a-a3dd-39a26a8027e0 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] 10.222.0.115 "GET /compute/v2.1/servers/f5aba9b4-e5cb-4693-a68d-c6c244c01dab" status: 200 len: 1318 microversion: 2.1 time: 0.154279 Aug 02 11:03:42.881193 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 502/991] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:03:42 2022] GET /compute/v2.1/servers/f5aba9b4-e5cb-4693-a68d-c6c244c01dab => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:03:43.730005 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-c3a3eecb-1365-4a4e-906d-10712efe2e59 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:03:43.730612 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-c3a3eecb-1365-4a4e-906d-10712efe2e59 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] [instance: 80d311f1-c318-410a-a86b-ec44b50b40ce] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:03:43.737394 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-c3a3eecb-1365-4a4e-906d-10712efe2e59 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:43.737849 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-c3a3eecb-1365-4a4e-906d-10712efe2e59 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:43.738631 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-c3a3eecb-1365-4a4e-906d-10712efe2e59 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:43.739110 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-c3a3eecb-1365-4a4e-906d-10712efe2e59 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:43.874671 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-c3a3eecb-1365-4a4e-906d-10712efe2e59 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf80e69ea524d83ab199fc7315f4be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ebdffccaaa04484b32602a67fe23629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:03:43.882431 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-c3a3eecb-1365-4a4e-906d-10712efe2e59 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] 10.222.0.115 "GET /compute/v2.1/servers/80d311f1-c318-410a-a86b-ec44b50b40ce" status: 200 len: 1323 microversion: 2.1 time: 0.156594 Aug 02 11:03:43.883102 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 490/992] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:03:43 2022] GET /compute/v2.1/servers/80d311f1-c318-410a-a86b-ec44b50b40ce => generated 1323 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:03:43.901973 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-8d578249-e9d2-4557-a4f7-32a733023e66 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:03:43.902675 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-8d578249-e9d2-4557-a4f7-32a733023e66 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] [instance: f5aba9b4-e5cb-4693-a68d-c6c244c01dab] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:03:43.910049 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-8d578249-e9d2-4557-a4f7-32a733023e66 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:43.910493 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-8d578249-e9d2-4557-a4f7-32a733023e66 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:43.911281 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-8d578249-e9d2-4557-a4f7-32a733023e66 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:43.911704 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-8d578249-e9d2-4557-a4f7-32a733023e66 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:44.040774 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-8d578249-e9d2-4557-a4f7-32a733023e66 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ba1b5dac82438391a56b7cda25a363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dccda1fb9a44c3d91811677bd6f36c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:03:44.048675 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-8d578249-e9d2-4557-a4f7-32a733023e66 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] 10.222.0.115 "GET /compute/v2.1/servers/f5aba9b4-e5cb-4693-a68d-c6c244c01dab" status: 200 len: 1318 microversion: 2.1 time: 0.150592 Aug 02 11:03:44.053958 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 503/993] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:03:43 2022] GET /compute/v2.1/servers/f5aba9b4-e5cb-4693-a68d-c6c244c01dab => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:03:44.904566 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-62f5edd2-b7e9-481c-9a4c-bc3ea13e110e tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:03:44.905181 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-62f5edd2-b7e9-481c-9a4c-bc3ea13e110e tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] [instance: 80d311f1-c318-410a-a86b-ec44b50b40ce] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:03:44.912058 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-62f5edd2-b7e9-481c-9a4c-bc3ea13e110e tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:44.912504 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-62f5edd2-b7e9-481c-9a4c-bc3ea13e110e tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:44.913277 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-62f5edd2-b7e9-481c-9a4c-bc3ea13e110e tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:44.913719 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-62f5edd2-b7e9-481c-9a4c-bc3ea13e110e tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:45.044419 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-62f5edd2-b7e9-481c-9a4c-bc3ea13e110e tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf80e69ea524d83ab199fc7315f4be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ebdffccaaa04484b32602a67fe23629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:03:45.052696 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-62f5edd2-b7e9-481c-9a4c-bc3ea13e110e tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] 10.222.0.115 "GET /compute/v2.1/servers/80d311f1-c318-410a-a86b-ec44b50b40ce" status: 200 len: 1323 microversion: 2.1 time: 0.152042 Aug 02 11:03:45.053268 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 491/994] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:03:44 2022] GET /compute/v2.1/servers/80d311f1-c318-410a-a86b-ec44b50b40ce => generated 1323 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:03:45.071017 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-b2a61763-5038-4362-801e-a6201594f47f tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:03:45.071017 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-b2a61763-5038-4362-801e-a6201594f47f tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] [instance: f5aba9b4-e5cb-4693-a68d-c6c244c01dab] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:03:45.080431 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-b2a61763-5038-4362-801e-a6201594f47f tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:45.080870 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-b2a61763-5038-4362-801e-a6201594f47f tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:45.081749 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-b2a61763-5038-4362-801e-a6201594f47f tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:45.082187 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-b2a61763-5038-4362-801e-a6201594f47f tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:45.221787 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-b2a61763-5038-4362-801e-a6201594f47f tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ba1b5dac82438391a56b7cda25a363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dccda1fb9a44c3d91811677bd6f36c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:03:45.229449 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-b2a61763-5038-4362-801e-a6201594f47f tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] 10.222.0.115 "GET /compute/v2.1/servers/f5aba9b4-e5cb-4693-a68d-c6c244c01dab" status: 200 len: 1502 microversion: 2.1 time: 0.163918 Aug 02 11:03:45.231271 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 504/995] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:03:45 2022] GET /compute/v2.1/servers/f5aba9b4-e5cb-4693-a68d-c6c244c01dab => generated 1502 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 11:03:46.073428 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-553a6a05-29f4-4906-89e7-a9eb6ec4677f tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:03:46.074051 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-553a6a05-29f4-4906-89e7-a9eb6ec4677f tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] [instance: 80d311f1-c318-410a-a86b-ec44b50b40ce] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:03:46.081236 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-553a6a05-29f4-4906-89e7-a9eb6ec4677f tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:46.081681 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-553a6a05-29f4-4906-89e7-a9eb6ec4677f tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:46.082448 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-553a6a05-29f4-4906-89e7-a9eb6ec4677f tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:46.082884 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-553a6a05-29f4-4906-89e7-a9eb6ec4677f tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:46.212703 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-553a6a05-29f4-4906-89e7-a9eb6ec4677f tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf80e69ea524d83ab199fc7315f4be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ebdffccaaa04484b32602a67fe23629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:03:46.220407 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-553a6a05-29f4-4906-89e7-a9eb6ec4677f tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] 10.222.0.115 "GET /compute/v2.1/servers/80d311f1-c318-410a-a86b-ec44b50b40ce" status: 200 len: 1323 microversion: 2.1 time: 0.150578 Aug 02 11:03:46.221158 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 492/996] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:03:46 2022] GET /compute/v2.1/servers/80d311f1-c318-410a-a86b-ec44b50b40ce => generated 1323 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:03:47.241214 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-aa2a9712-9782-4036-8d40-8733f8c00876 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:03:47.241820 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-aa2a9712-9782-4036-8d40-8733f8c00876 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] [instance: 80d311f1-c318-410a-a86b-ec44b50b40ce] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:03:47.248993 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-aa2a9712-9782-4036-8d40-8733f8c00876 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:47.249466 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-aa2a9712-9782-4036-8d40-8733f8c00876 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:47.250236 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-aa2a9712-9782-4036-8d40-8733f8c00876 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:47.250662 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-aa2a9712-9782-4036-8d40-8733f8c00876 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:47.384965 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-aa2a9712-9782-4036-8d40-8733f8c00876 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf80e69ea524d83ab199fc7315f4be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ebdffccaaa04484b32602a67fe23629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:03:47.393214 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-aa2a9712-9782-4036-8d40-8733f8c00876 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] 10.222.0.115 "GET /compute/v2.1/servers/80d311f1-c318-410a-a86b-ec44b50b40ce" status: 200 len: 1323 microversion: 2.1 time: 0.156024 Aug 02 11:03:47.393873 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 505/997] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:03:47 2022] GET /compute/v2.1/servers/80d311f1-c318-410a-a86b-ec44b50b40ce => generated 1323 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:03:48.414456 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-5e5fb32f-218c-4ffa-9602-60edf9530a7b tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:03:48.415100 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-5e5fb32f-218c-4ffa-9602-60edf9530a7b tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] [instance: 80d311f1-c318-410a-a86b-ec44b50b40ce] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:03:48.417602 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG dbcounter [-] [129952] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=129952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 11:03:48.422624 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-5e5fb32f-218c-4ffa-9602-60edf9530a7b tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:48.423669 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-5e5fb32f-218c-4ffa-9602-60edf9530a7b tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:48.428417 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-5e5fb32f-218c-4ffa-9602-60edf9530a7b tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:48.428417 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-5e5fb32f-218c-4ffa-9602-60edf9530a7b tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:48.570214 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-5e5fb32f-218c-4ffa-9602-60edf9530a7b tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf80e69ea524d83ab199fc7315f4be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ebdffccaaa04484b32602a67fe23629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:03:48.578012 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-5e5fb32f-218c-4ffa-9602-60edf9530a7b tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] 10.222.0.115 "GET /compute/v2.1/servers/80d311f1-c318-410a-a86b-ec44b50b40ce" status: 200 len: 1323 microversion: 2.1 time: 0.167365 Aug 02 11:03:48.578503 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 493/998] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:03:48 2022] GET /compute/v2.1/servers/80d311f1-c318-410a-a86b-ec44b50b40ce => generated 1323 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:03:49.599177 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-ab49dce9-d765-48ef-8f07-7525f1a32461 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:03:49.599792 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-ab49dce9-d765-48ef-8f07-7525f1a32461 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] [instance: 80d311f1-c318-410a-a86b-ec44b50b40ce] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:03:49.606387 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-ab49dce9-d765-48ef-8f07-7525f1a32461 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:49.608355 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-ab49dce9-d765-48ef-8f07-7525f1a32461 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:49.608355 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-ab49dce9-d765-48ef-8f07-7525f1a32461 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:49.608355 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-ab49dce9-d765-48ef-8f07-7525f1a32461 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:49.745109 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-ab49dce9-d765-48ef-8f07-7525f1a32461 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf80e69ea524d83ab199fc7315f4be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ebdffccaaa04484b32602a67fe23629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:03:49.753813 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-ab49dce9-d765-48ef-8f07-7525f1a32461 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] 10.222.0.115 "GET /compute/v2.1/servers/80d311f1-c318-410a-a86b-ec44b50b40ce" status: 200 len: 1512 microversion: 2.1 time: 0.157835 Aug 02 11:03:49.754371 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 506/999] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:03:49 2022] GET /compute/v2.1/servers/80d311f1-c318-410a-a86b-ec44b50b40ce => generated 1512 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:03:52.289464 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-d714616f-bc69-4de9-8435-ab464390ba3c tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:03:52.290251 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-d714616f-bc69-4de9-8435-ab464390ba3c tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] [instance: f5aba9b4-e5cb-4693-a68d-c6c244c01dab] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:03:52.296838 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-d714616f-bc69-4de9-8435-ab464390ba3c tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:52.297283 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-d714616f-bc69-4de9-8435-ab464390ba3c tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:52.298103 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-d714616f-bc69-4de9-8435-ab464390ba3c tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:52.298532 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-d714616f-bc69-4de9-8435-ab464390ba3c tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:52.324212 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-d714616f-bc69-4de9-8435-ab464390ba3c tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] [instance: f5aba9b4-e5cb-4693-a68d-c6c244c01dab] Going to try to terminate instance {{(pid=129952) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 11:03:52.361536 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG dbcounter [-] [129952] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=129952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 11:03:52.655348 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-d714616f-bc69-4de9-8435-ab464390ba3c tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] 10.222.0.115 "DELETE /compute/v2.1/servers/f5aba9b4-e5cb-4693-a68d-c6c244c01dab" status: 204 len: 0 microversion: 2.1 time: 0.369430 Aug 02 11:03:52.656230 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 494/1000] 10.222.0.115 () {58 vars in 1244 bytes} [Tue Aug 2 11:03:52 2022] DELETE /compute/v2.1/servers/f5aba9b4-e5cb-4693-a68d-c6c244c01dab => generated 0 bytes in 372 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 02 11:03:52.665305 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-6b70f2ca-0e7a-4482-a908-d24f55427333 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:03:52.666015 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-6b70f2ca-0e7a-4482-a908-d24f55427333 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] [instance: f5aba9b4-e5cb-4693-a68d-c6c244c01dab] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:03:52.672925 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-6b70f2ca-0e7a-4482-a908-d24f55427333 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:52.674424 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-6b70f2ca-0e7a-4482-a908-d24f55427333 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:52.675337 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-6b70f2ca-0e7a-4482-a908-d24f55427333 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:52.675768 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-6b70f2ca-0e7a-4482-a908-d24f55427333 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:52.828255 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-6b70f2ca-0e7a-4482-a908-d24f55427333 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ba1b5dac82438391a56b7cda25a363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dccda1fb9a44c3d91811677bd6f36c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:03:52.837766 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-6b70f2ca-0e7a-4482-a908-d24f55427333 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] 10.222.0.115 "GET /compute/v2.1/servers/f5aba9b4-e5cb-4693-a68d-c6c244c01dab" status: 200 len: 1508 microversion: 2.1 time: 0.176325 Aug 02 11:03:52.838341 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 507/1001] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:03:52 2022] GET /compute/v2.1/servers/f5aba9b4-e5cb-4693-a68d-c6c244c01dab => generated 1508 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:03:53.859380 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-c6aeca92-2c54-44b6-9bdb-4f8b7d1bc001 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:03:53.860097 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-c6aeca92-2c54-44b6-9bdb-4f8b7d1bc001 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] [instance: f5aba9b4-e5cb-4693-a68d-c6c244c01dab] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:03:53.868377 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-c6aeca92-2c54-44b6-9bdb-4f8b7d1bc001 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:53.868827 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-c6aeca92-2c54-44b6-9bdb-4f8b7d1bc001 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:53.869616 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-c6aeca92-2c54-44b6-9bdb-4f8b7d1bc001 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:53.870052 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-c6aeca92-2c54-44b6-9bdb-4f8b7d1bc001 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:54.011850 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-c6aeca92-2c54-44b6-9bdb-4f8b7d1bc001 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ba1b5dac82438391a56b7cda25a363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dccda1fb9a44c3d91811677bd6f36c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:03:54.020980 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-c6aeca92-2c54-44b6-9bdb-4f8b7d1bc001 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] 10.222.0.115 "GET /compute/v2.1/servers/f5aba9b4-e5cb-4693-a68d-c6c244c01dab" status: 200 len: 1508 microversion: 2.1 time: 0.165985 Aug 02 11:03:54.021559 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 495/1002] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:03:53 2022] GET /compute/v2.1/servers/f5aba9b4-e5cb-4693-a68d-c6c244c01dab => generated 1508 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:03:54.959592 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [req-93932312-e5c1-4a81-94c4-7974552ee920 req-d68db9e2-0017-4b46-a4f3-7c94544fb3f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5aba9b4-e5cb-4693-a68d-c6c244c01dab", "name": "network-vif-deleted", "tag": "88501b93-c35b-4458-a1ad-cfd46623f75b"}]} {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 11:03:54.964873 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG dbcounter [-] [129953] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3 {{(pid=129953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 11:03:54.970188 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [req-93932312-e5c1-4a81-94c4-7974552ee920 req-d68db9e2-0017-4b46-a4f3-7c94544fb3f2 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:54.970621 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [req-93932312-e5c1-4a81-94c4-7974552ee920 req-d68db9e2-0017-4b46-a4f3-7c94544fb3f2 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:54.982665 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.compute.server_external_events [req-93932312-e5c1-4a81-94c4-7974552ee920 req-d68db9e2-0017-4b46-a4f3-7c94544fb3f2 service nova] Creating event network-vif-deleted:88501b93-c35b-4458-a1ad-cfd46623f75b for instance f5aba9b4-e5cb-4693-a68d-c6c244c01dab on hv-cinder-85031 Aug 02 11:03:54.988025 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [req-93932312-e5c1-4a81-94c4-7974552ee920 req-d68db9e2-0017-4b46-a4f3-7c94544fb3f2 service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032463 Aug 02 11:03:54.988566 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 508/1003] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Aug 2 11:03:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 11:03:55.042117 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-c15ec3c1-0de8-43a3-a8f0-bf68b405cd31 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:03:55.042728 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-c15ec3c1-0de8-43a3-a8f0-bf68b405cd31 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] [instance: f5aba9b4-e5cb-4693-a68d-c6c244c01dab] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:03:55.049419 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-c15ec3c1-0de8-43a3-a8f0-bf68b405cd31 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:55.049895 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-c15ec3c1-0de8-43a3-a8f0-bf68b405cd31 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:55.050665 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-c15ec3c1-0de8-43a3-a8f0-bf68b405cd31 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:55.051115 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-c15ec3c1-0de8-43a3-a8f0-bf68b405cd31 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:55.113505 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-c15ec3c1-0de8-43a3-a8f0-bf68b405cd31 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ba1b5dac82438391a56b7cda25a363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dccda1fb9a44c3d91811677bd6f36c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:03:55.121027 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-c15ec3c1-0de8-43a3-a8f0-bf68b405cd31 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] 10.222.0.115 "GET /compute/v2.1/servers/f5aba9b4-e5cb-4693-a68d-c6c244c01dab" status: 200 len: 1466 microversion: 2.1 time: 0.082782 Aug 02 11:03:55.121591 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 496/1004] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:03:55 2022] GET /compute/v2.1/servers/f5aba9b4-e5cb-4693-a68d-c6c244c01dab => generated 1466 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:03:56.143873 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-591ea039-4e4d-47a4-9572-d5b6de40df10 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:03:56.144576 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-591ea039-4e4d-47a4-9572-d5b6de40df10 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] [instance: f5aba9b4-e5cb-4693-a68d-c6c244c01dab] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:03:56.151688 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-591ea039-4e4d-47a4-9572-d5b6de40df10 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:56.152133 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-591ea039-4e4d-47a4-9572-d5b6de40df10 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:56.152903 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-591ea039-4e4d-47a4-9572-d5b6de40df10 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:56.153334 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-591ea039-4e4d-47a4-9572-d5b6de40df10 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:56.216773 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-591ea039-4e4d-47a4-9572-d5b6de40df10 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ba1b5dac82438391a56b7cda25a363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dccda1fb9a44c3d91811677bd6f36c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:03:56.225127 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-591ea039-4e4d-47a4-9572-d5b6de40df10 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] 10.222.0.115 "GET /compute/v2.1/servers/f5aba9b4-e5cb-4693-a68d-c6c244c01dab" status: 200 len: 1466 microversion: 2.1 time: 0.086550 Aug 02 11:03:56.225749 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 509/1005] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:03:56 2022] GET /compute/v2.1/servers/f5aba9b4-e5cb-4693-a68d-c6c244c01dab => generated 1466 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:03:57.246987 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-2311e00a-3c9d-43a3-9e43-6138c705f93e tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:03:57.247829 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-2311e00a-3c9d-43a3-9e43-6138c705f93e tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] [instance: f5aba9b4-e5cb-4693-a68d-c6c244c01dab] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:03:57.255064 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-2311e00a-3c9d-43a3-9e43-6138c705f93e tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:57.255575 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-2311e00a-3c9d-43a3-9e43-6138c705f93e tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:57.256353 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-2311e00a-3c9d-43a3-9e43-6138c705f93e tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:57.256792 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-2311e00a-3c9d-43a3-9e43-6138c705f93e tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:57.326876 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-2311e00a-3c9d-43a3-9e43-6138c705f93e tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ba1b5dac82438391a56b7cda25a363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dccda1fb9a44c3d91811677bd6f36c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:03:57.335081 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-2311e00a-3c9d-43a3-9e43-6138c705f93e tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] 10.222.0.115 "GET /compute/v2.1/servers/f5aba9b4-e5cb-4693-a68d-c6c244c01dab" status: 200 len: 1466 microversion: 2.1 time: 0.092041 Aug 02 11:03:57.335669 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 497/1006] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:03:57 2022] GET /compute/v2.1/servers/f5aba9b4-e5cb-4693-a68d-c6c244c01dab => generated 1466 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:03:58.356537 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-a93241b9-d16b-4397-a45d-a7caa208b7f2 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:03:58.359578 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-a93241b9-d16b-4397-a45d-a7caa208b7f2 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] [instance: f5aba9b4-e5cb-4693-a68d-c6c244c01dab] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:03:58.365081 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-a93241b9-d16b-4397-a45d-a7caa208b7f2 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:58.365571 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-a93241b9-d16b-4397-a45d-a7caa208b7f2 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:58.366353 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-a93241b9-d16b-4397-a45d-a7caa208b7f2 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:58.366780 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-a93241b9-d16b-4397-a45d-a7caa208b7f2 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:58.403446 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-a93241b9-d16b-4397-a45d-a7caa208b7f2 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:58.403894 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-a93241b9-d16b-4397-a45d-a7caa208b7f2 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:58.404363 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.objects.instance [None req-a93241b9-d16b-4397-a45d-a7caa208b7f2 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lazy-loading 'fault' on Instance uuid f5aba9b4-e5cb-4693-a68d-c6c244c01dab {{(pid=129953) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 11:03:58.449795 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-a93241b9-d16b-4397-a45d-a7caa208b7f2 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ba1b5dac82438391a56b7cda25a363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dccda1fb9a44c3d91811677bd6f36c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:03:58.458603 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-a93241b9-d16b-4397-a45d-a7caa208b7f2 tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] 10.222.0.115 "GET /compute/v2.1/servers/f5aba9b4-e5cb-4693-a68d-c6c244c01dab" status: 200 len: 1308 microversion: 2.1 time: 0.106036 Aug 02 11:03:58.459221 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 510/1007] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:03:58 2022] GET /compute/v2.1/servers/f5aba9b4-e5cb-4693-a68d-c6c244c01dab => generated 1308 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:03:59.493027 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-65b9aaef-d7b9-4dd3-a152-e4a3aea1cdfa tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:03:59.493730 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-65b9aaef-d7b9-4dd3-a152-e4a3aea1cdfa tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] [instance: f5aba9b4-e5cb-4693-a68d-c6c244c01dab] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:03:59.500963 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-65b9aaef-d7b9-4dd3-a152-e4a3aea1cdfa tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:59.501436 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-65b9aaef-d7b9-4dd3-a152-e4a3aea1cdfa tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:59.502233 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-65b9aaef-d7b9-4dd3-a152-e4a3aea1cdfa tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:03:59.502688 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-65b9aaef-d7b9-4dd3-a152-e4a3aea1cdfa tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:03:59.516726 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.wsgi [None req-65b9aaef-d7b9-4dd3-a152-e4a3aea1cdfa tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] HTTP exception thrown: Instance f5aba9b4-e5cb-4693-a68d-c6c244c01dab could not be found. Aug 02 11:03:59.518421 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-65b9aaef-d7b9-4dd3-a152-e4a3aea1cdfa tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Request method failure captured: Aug 02 11:03:59.518421 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: request: GET /compute/v2.1/servers/f5aba9b4-e5cb-4693-a68d-c6c244c01dab HTTP/1.1 Aug 02 11:03:59.518421 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Accept: application/json Aug 02 11:03:59.518421 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Accept-Encoding: identity Aug 02 11:03:59.518421 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Connection: close Aug 02 11:03:59.518421 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Content-Length: 0 Aug 02 11:03:59.518421 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Content-Type: application/json Aug 02 11:03:59.518421 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Host: 10.222.0.115 Aug 02 11:03:59.518421 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Openstack-System-Scope: None Aug 02 11:03:59.518421 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: User-Agent: python-urllib3/1.26.10 Aug 02 11:03:59.518421 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Auth-Token: gAAAAABi6QRcFTCvnODZoFDRgn1-exDWbX92HOkeMkS1OEW6B_T0wWuhdJPmnElu1xrqeLrKWZloMaQaE9OvWmjh1VZaLC_QXgJ2kkZu0XqxcKdiksCyalhLvicZ0qFDgrYjLwvycBKgn9ajyQHzvl1liY-KRZi6yFhUbe8QBdp6PE1OhnFTssg Aug 02 11:03:59.518421 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Domain-Id: None Aug 02 11:03:59.518421 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Domain-Name: None Aug 02 11:03:59.518421 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Identity-Status: Confirmed Aug 02 11:03:59.518421 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Is-Admin-Project: True Aug 02 11:03:59.518421 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Project-Domain-Id: default Aug 02 11:03:59.518421 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Project-Domain-Name: Default Aug 02 11:03:59.518421 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Project-Id: 4dccda1fb9a44c3d91811677bd6f36c3 Aug 02 11:03:59.518421 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Project-Name: tempest-VolumesActionsTest-1935531505 Aug 02 11:03:59.518421 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Role: reader,member Aug 02 11:03:59.518421 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Roles: reader,member Aug 02 11:03:59.520982 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/4dccda1fb9a44c3d91811677bd6f36c3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2/4dccda1fb9a44c3d91811677bd6f36c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/4dccda1fb9a44c3d91811677bd6f36c3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.115:8080", "publicURL": "http://10.222.0.115:8080/v1/AUTH_4dccda1fb9a44c3d91811677bd6f36c3"}]}] Aug 02 11:03:59.520982 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Tenant: tempest-VolumesActionsTest-1935531505 Aug 02 11:03:59.520982 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Tenant-Id: 4dccda1fb9a44c3d91811677bd6f36c3 Aug 02 11:03:59.520982 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Tenant-Name: tempest-VolumesActionsTest-1935531505 Aug 02 11:03:59.520982 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User: tempest-VolumesActionsTest-1935531505-project Aug 02 11:03:59.520982 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User-Domain-Id: default Aug 02 11:03:59.520982 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User-Domain-Name: Default Aug 02 11:03:59.520982 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User-Id: d4ba1b5dac82438391a56b7cda25a363 Aug 02 11:03:59.520982 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User-Name: tempest-VolumesActionsTest-1935531505-project Aug 02 11:03:59.520982 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: method: > Aug 02 11:03:59.520982 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: exception: Instance f5aba9b4-e5cb-4693-a68d-c6c244c01dab could not be found. Aug 02 11:03:59.520982 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: action_args: {'id': 'f5aba9b4-e5cb-4693-a68d-c6c244c01dab'} Aug 02 11:03:59.522033 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 11:03:59.522033 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:03:59.522033 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 11:03:59.522033 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 11:03:59.522033 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 11:03:59.522033 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 11:03:59.522033 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 11:03:59.522033 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 11:03:59.522033 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 11:03:59.522033 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 11:03:59.522033 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5aba9b4-e5cb-4693-a68d-c6c244c01dab could not be found. Aug 02 11:03:59.522033 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 11:03:59.522033 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 11:03:59.522033 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 11:03:59.522033 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:03:59.522033 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 11:03:59.522033 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 11:03:59.522033 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 11:03:59.522033 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 11:03:59.522033 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 11:03:59.523743 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 11:03:59.523743 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 11:03:59.523743 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 11:03:59.523743 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 11:03:59.523743 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 11:03:59.523743 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 11:03:59.523743 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 11:03:59.523743 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5aba9b4-e5cb-4693-a68d-c6c244c01dab could not be found. Aug 02 11:03:59.523743 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 11:03:59.523743 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 11:03:59.523743 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 11:03:59.523743 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:03:59.523743 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 11:03:59.523743 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 11:03:59.523743 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 11:03:59.523743 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 11:03:59.523743 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5aba9b4-e5cb-4693-a68d-c6c244c01dab could not be found. Aug 02 11:03:59.523743 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 11:03:59.525319 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-65b9aaef-d7b9-4dd3-a152-e4a3aea1cdfa tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] Returning 404 to user: Instance f5aba9b4-e5cb-4693-a68d-c6c244c01dab could not be found. {{(pid=129952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 11:03:59.525319 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-65b9aaef-d7b9-4dd3-a152-e4a3aea1cdfa tempest-VolumesActionsTest-1935531505 tempest-VolumesActionsTest-1935531505-project] 10.222.0.115 "GET /compute/v2.1/servers/f5aba9b4-e5cb-4693-a68d-c6c244c01dab" status: 404 len: 111 microversion: 2.1 time: 0.031575 Aug 02 11:03:59.525319 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 498/1008] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:03:59 2022] GET /compute/v2.1/servers/f5aba9b4-e5cb-4693-a68d-c6c244c01dab => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 11:04:05.727057 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-8db26509-1b3b-43fa-bb26-1f7ea433f2f7 tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-434059235", "imageRef": "aa0a7b8c-0dd6-4803-8767-cb8c2d05fdd4", "flavorRef": "452"}} {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 11:04:05.779308 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.network.neutron [None req-8db26509-1b3b-43fa-bb26-1f7ea433f2f7 tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] validate_networks() for None {{(pid=129953) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 11:04:06.069846 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.virt.hardware [None req-8db26509-1b3b-43fa-bb26-1f7ea433f2f7 tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Flavor limits 0:0:0 {{(pid=129953) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 11:04:06.069846 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.virt.hardware [None req-8db26509-1b3b-43fa-bb26-1f7ea433f2f7 tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Image limits 0:0:0 {{(pid=129953) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 11:04:06.069846 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.virt.hardware [None req-8db26509-1b3b-43fa-bb26-1f7ea433f2f7 tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Flavor pref 0:0:0 {{(pid=129953) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 11:04:06.069846 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.virt.hardware [None req-8db26509-1b3b-43fa-bb26-1f7ea433f2f7 tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Image pref 0:0:0 {{(pid=129953) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 11:04:06.069846 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.virt.hardware [None req-8db26509-1b3b-43fa-bb26-1f7ea433f2f7 tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129953) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 11:04:06.081814 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-8db26509-1b3b-43fa-bb26-1f7ea433f2f7 tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:04:06.083337 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-8db26509-1b3b-43fa-bb26-1f7ea433f2f7 tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:04:06.084401 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-8db26509-1b3b-43fa-bb26-1f7ea433f2f7 tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:04:06.084908 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-8db26509-1b3b-43fa-bb26-1f7ea433f2f7 tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:04:06.095783 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG dbcounter [-] [129953] Writing DB stats nova_cell1:SELECT=93 {{(pid=129953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 11:04:06.120325 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.quota [None req-8db26509-1b3b-43fa-bb26-1f7ea433f2f7 tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Getting quotas for project 18a92e65eb7546048be4b7c215257f70. Resources: {'instances', 'cores', 'ram'} {{(pid=129953) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 11:04:06.125318 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.quota [None req-8db26509-1b3b-43fa-bb26-1f7ea433f2f7 tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Getting quotas for user 9ab9773545044cbf8e6f0318fe649f9d and project 18a92e65eb7546048be4b7c215257f70. Resources: {'instances', 'cores', 'ram'} {{(pid=129953) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 11:04:06.138119 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-8db26509-1b3b-43fa-bb26-1f7ea433f2f7 tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Going to run 1 instances... {{(pid=129953) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 11:04:06.140473 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-8db26509-1b3b-43fa-bb26-1f7ea433f2f7 tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] [instance: d2f5377c-09ed-45bc-b72e-ef00b95482ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aa0a7b8c-0dd6-4803-8767-cb8c2d05fdd4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129953) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 11:04:06.288453 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-8db26509-1b3b-43fa-bb26-1f7ea433f2f7 tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] 10.222.0.115 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.565498 Aug 02 11:04:06.289797 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 511/1009] 10.222.0.115 () {60 vars in 1152 bytes} [Tue Aug 2 11:04:05 2022] POST /compute/v2.1/servers => generated 382 bytes in 568 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 02 11:04:06.302377 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-1e229f52-2974-4bb4-ad79-e0daa3a9cf80 tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:04:06.303788 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-1e229f52-2974-4bb4-ad79-e0daa3a9cf80 tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] [instance: d2f5377c-09ed-45bc-b72e-ef00b95482ef] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:04:06.380416 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-1e229f52-2974-4bb4-ad79-e0daa3a9cf80 tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab9773545044cbf8e6f0318fe649f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a92e65eb7546048be4b7c215257f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:04:06.391526 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-1e229f52-2974-4bb4-ad79-e0daa3a9cf80 tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] 10.222.0.115 "GET /compute/v2.1/servers/d2f5377c-09ed-45bc-b72e-ef00b95482ef" status: 200 len: 1218 microversion: 2.1 time: 0.093787 Aug 02 11:04:06.392932 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 499/1010] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:04:06 2022] GET /compute/v2.1/servers/d2f5377c-09ed-45bc-b72e-ef00b95482ef => generated 1218 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:04:07.415596 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-18916c39-84d1-4f81-8348-620c0031b706 tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:04:07.416404 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-18916c39-84d1-4f81-8348-620c0031b706 tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] [instance: d2f5377c-09ed-45bc-b72e-ef00b95482ef] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:04:07.482176 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-18916c39-84d1-4f81-8348-620c0031b706 tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab9773545044cbf8e6f0318fe649f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a92e65eb7546048be4b7c215257f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:04:07.491094 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-18916c39-84d1-4f81-8348-620c0031b706 tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] 10.222.0.115 "GET /compute/v2.1/servers/d2f5377c-09ed-45bc-b72e-ef00b95482ef" status: 200 len: 1218 microversion: 2.1 time: 0.080952 Aug 02 11:04:07.495247 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 512/1011] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:04:07 2022] GET /compute/v2.1/servers/d2f5377c-09ed-45bc-b72e-ef00b95482ef => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:04:08.515634 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-61ebb48b-b329-421e-86cb-7ed259c9b0bb tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:04:08.516419 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-61ebb48b-b329-421e-86cb-7ed259c9b0bb tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] [instance: d2f5377c-09ed-45bc-b72e-ef00b95482ef] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:04:08.526634 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-61ebb48b-b329-421e-86cb-7ed259c9b0bb tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:04:08.527222 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-61ebb48b-b329-421e-86cb-7ed259c9b0bb tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:04:08.528295 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-61ebb48b-b329-421e-86cb-7ed259c9b0bb tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:04:08.528738 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-61ebb48b-b329-421e-86cb-7ed259c9b0bb tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:04:08.608101 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-61ebb48b-b329-421e-86cb-7ed259c9b0bb tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab9773545044cbf8e6f0318fe649f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a92e65eb7546048be4b7c215257f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:04:08.620732 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-61ebb48b-b329-421e-86cb-7ed259c9b0bb tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] 10.222.0.115 "GET /compute/v2.1/servers/d2f5377c-09ed-45bc-b72e-ef00b95482ef" status: 200 len: 1270 microversion: 2.1 time: 0.109526 Aug 02 11:04:08.621342 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 500/1012] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:04:08 2022] GET /compute/v2.1/servers/d2f5377c-09ed-45bc-b72e-ef00b95482ef => generated 1270 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:04:09.649292 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-f596537e-5960-45dc-8b90-e1cbb2e551b2 tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:04:09.650118 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-f596537e-5960-45dc-8b90-e1cbb2e551b2 tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] [instance: d2f5377c-09ed-45bc-b72e-ef00b95482ef] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:04:09.657730 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-f596537e-5960-45dc-8b90-e1cbb2e551b2 tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:04:09.658527 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-f596537e-5960-45dc-8b90-e1cbb2e551b2 tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:04:09.659578 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-f596537e-5960-45dc-8b90-e1cbb2e551b2 tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:04:09.661005 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-f596537e-5960-45dc-8b90-e1cbb2e551b2 tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:04:09.748749 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-f596537e-5960-45dc-8b90-e1cbb2e551b2 tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab9773545044cbf8e6f0318fe649f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a92e65eb7546048be4b7c215257f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:04:09.758755 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-f596537e-5960-45dc-8b90-e1cbb2e551b2 tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] 10.222.0.115 "GET /compute/v2.1/servers/d2f5377c-09ed-45bc-b72e-ef00b95482ef" status: 200 len: 1276 microversion: 2.1 time: 0.115211 Aug 02 11:04:09.771455 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 513/1013] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:04:09 2022] GET /compute/v2.1/servers/d2f5377c-09ed-45bc-b72e-ef00b95482ef => generated 1276 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:04:10.783017 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-d1f9249e-047b-42c4-9873-d36bee30b676 tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:04:10.784249 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-d1f9249e-047b-42c4-9873-d36bee30b676 tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] [instance: d2f5377c-09ed-45bc-b72e-ef00b95482ef] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:04:10.792043 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-d1f9249e-047b-42c4-9873-d36bee30b676 tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:04:10.792940 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-d1f9249e-047b-42c4-9873-d36bee30b676 tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:04:10.793938 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-d1f9249e-047b-42c4-9873-d36bee30b676 tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:04:10.794595 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-d1f9249e-047b-42c4-9873-d36bee30b676 tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:04:11.157731 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-d1f9249e-047b-42c4-9873-d36bee30b676 tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab9773545044cbf8e6f0318fe649f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a92e65eb7546048be4b7c215257f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:04:11.168801 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-d1f9249e-047b-42c4-9873-d36bee30b676 tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] 10.222.0.115 "GET /compute/v2.1/servers/d2f5377c-09ed-45bc-b72e-ef00b95482ef" status: 200 len: 1318 microversion: 2.1 time: 0.390657 Aug 02 11:04:11.169386 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 501/1014] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:04:10 2022] GET /compute/v2.1/servers/d2f5377c-09ed-45bc-b72e-ef00b95482ef => generated 1318 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:04:11.955303 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [req-6645c1e4-9175-47ac-94c5-057a466ff36c req-ca247976-e992-4be9-9b0c-7ee55c0e5b1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2f5377c-09ed-45bc-b72e-ef00b95482ef", "tag": "5ec36a51-91de-4277-a817-5bb6332c8d28"}]} {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 11:04:11.979655 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [req-6645c1e4-9175-47ac-94c5-057a466ff36c req-ca247976-e992-4be9-9b0c-7ee55c0e5b1f service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:04:11.981064 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [req-6645c1e4-9175-47ac-94c5-057a466ff36c req-ca247976-e992-4be9-9b0c-7ee55c0e5b1f service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:04:11.995002 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.compute.server_external_events [req-6645c1e4-9175-47ac-94c5-057a466ff36c req-ca247976-e992-4be9-9b0c-7ee55c0e5b1f service nova] Creating event network-changed:5ec36a51-91de-4277-a817-5bb6332c8d28 for instance d2f5377c-09ed-45bc-b72e-ef00b95482ef on hv-cinder-85031 Aug 02 11:04:12.001022 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [req-6645c1e4-9175-47ac-94c5-057a466ff36c req-ca247976-e992-4be9-9b0c-7ee55c0e5b1f service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049461 Aug 02 11:04:12.002274 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 514/1015] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Aug 2 11:04:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 11:04:12.191623 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-cb5a8797-df8a-464c-8488-493c6e422a37 tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:04:12.192400 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-cb5a8797-df8a-464c-8488-493c6e422a37 tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] [instance: d2f5377c-09ed-45bc-b72e-ef00b95482ef] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:04:12.198822 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-cb5a8797-df8a-464c-8488-493c6e422a37 tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:04:12.199293 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-cb5a8797-df8a-464c-8488-493c6e422a37 tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:04:12.200068 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-cb5a8797-df8a-464c-8488-493c6e422a37 tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:04:12.200499 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-cb5a8797-df8a-464c-8488-493c6e422a37 tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:04:12.392585 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-cb5a8797-df8a-464c-8488-493c6e422a37 tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab9773545044cbf8e6f0318fe649f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a92e65eb7546048be4b7c215257f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:04:12.403430 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-cb5a8797-df8a-464c-8488-493c6e422a37 tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] 10.222.0.115 "GET /compute/v2.1/servers/d2f5377c-09ed-45bc-b72e-ef00b95482ef" status: 200 len: 1318 microversion: 2.1 time: 0.216171 Aug 02 11:04:12.404097 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 502/1016] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:04:12 2022] GET /compute/v2.1/servers/d2f5377c-09ed-45bc-b72e-ef00b95482ef => generated 1318 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:04:13.426772 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-f4c08126-56f1-4bba-8b67-b5a5a934d47d tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:04:13.428689 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-f4c08126-56f1-4bba-8b67-b5a5a934d47d tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] [instance: d2f5377c-09ed-45bc-b72e-ef00b95482ef] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:04:13.436975 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-f4c08126-56f1-4bba-8b67-b5a5a934d47d tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:04:13.437670 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-f4c08126-56f1-4bba-8b67-b5a5a934d47d tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:04:13.438850 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-f4c08126-56f1-4bba-8b67-b5a5a934d47d tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:04:13.439792 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-f4c08126-56f1-4bba-8b67-b5a5a934d47d tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:04:13.629746 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-f4c08126-56f1-4bba-8b67-b5a5a934d47d tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab9773545044cbf8e6f0318fe649f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a92e65eb7546048be4b7c215257f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:04:13.638065 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-f4c08126-56f1-4bba-8b67-b5a5a934d47d tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] 10.222.0.115 "GET /compute/v2.1/servers/d2f5377c-09ed-45bc-b72e-ef00b95482ef" status: 200 len: 1318 microversion: 2.1 time: 0.216823 Aug 02 11:04:13.638720 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 515/1017] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:04:13 2022] GET /compute/v2.1/servers/d2f5377c-09ed-45bc-b72e-ef00b95482ef => generated 1318 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 11:04:14.667659 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-ca9d0afb-278e-4434-9296-099d275174e4 tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:04:14.668310 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-ca9d0afb-278e-4434-9296-099d275174e4 tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] [instance: d2f5377c-09ed-45bc-b72e-ef00b95482ef] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:04:14.675513 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-ca9d0afb-278e-4434-9296-099d275174e4 tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:04:14.675981 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-ca9d0afb-278e-4434-9296-099d275174e4 tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:04:14.676854 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-ca9d0afb-278e-4434-9296-099d275174e4 tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:04:14.677293 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-ca9d0afb-278e-4434-9296-099d275174e4 tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:04:14.851756 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-ca9d0afb-278e-4434-9296-099d275174e4 tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab9773545044cbf8e6f0318fe649f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a92e65eb7546048be4b7c215257f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:04:14.860464 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-ca9d0afb-278e-4434-9296-099d275174e4 tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] 10.222.0.115 "GET /compute/v2.1/servers/d2f5377c-09ed-45bc-b72e-ef00b95482ef" status: 200 len: 1318 microversion: 2.1 time: 0.197137 Aug 02 11:04:14.861065 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 503/1018] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:04:14 2022] GET /compute/v2.1/servers/d2f5377c-09ed-45bc-b72e-ef00b95482ef => generated 1318 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:04:15.885169 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-b181c586-da02-456b-a480-29c3206216cc tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:04:15.900707 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-b181c586-da02-456b-a480-29c3206216cc tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] [instance: d2f5377c-09ed-45bc-b72e-ef00b95482ef] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:04:15.920279 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-b181c586-da02-456b-a480-29c3206216cc tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:04:15.920906 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-b181c586-da02-456b-a480-29c3206216cc tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:04:15.922589 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-b181c586-da02-456b-a480-29c3206216cc tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:04:15.923514 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-b181c586-da02-456b-a480-29c3206216cc tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:04:16.099673 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG dbcounter [-] [129953] Writing DB stats nova_cell0:SELECT=2 {{(pid=129953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 11:04:16.157451 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-b181c586-da02-456b-a480-29c3206216cc tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab9773545044cbf8e6f0318fe649f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a92e65eb7546048be4b7c215257f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:04:16.174304 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-b181c586-da02-456b-a480-29c3206216cc tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] 10.222.0.115 "GET /compute/v2.1/servers/d2f5377c-09ed-45bc-b72e-ef00b95482ef" status: 200 len: 1318 microversion: 2.1 time: 0.294812 Aug 02 11:04:16.176947 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 516/1019] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:04:15 2022] GET /compute/v2.1/servers/d2f5377c-09ed-45bc-b72e-ef00b95482ef => generated 1318 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:04:17.199569 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-4899debe-b17b-46e0-bbc0-50321310c9b8 tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:04:17.200183 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-4899debe-b17b-46e0-bbc0-50321310c9b8 tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] [instance: d2f5377c-09ed-45bc-b72e-ef00b95482ef] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:04:17.202614 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG dbcounter [-] [129952] Writing DB stats nova_cell0:SELECT=2 {{(pid=129952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 11:04:17.209092 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-4899debe-b17b-46e0-bbc0-50321310c9b8 tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:04:17.209554 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-4899debe-b17b-46e0-bbc0-50321310c9b8 tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:04:17.210401 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-4899debe-b17b-46e0-bbc0-50321310c9b8 tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:04:17.210899 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-4899debe-b17b-46e0-bbc0-50321310c9b8 tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:04:17.422223 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-4899debe-b17b-46e0-bbc0-50321310c9b8 tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab9773545044cbf8e6f0318fe649f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a92e65eb7546048be4b7c215257f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:04:17.432624 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-4899debe-b17b-46e0-bbc0-50321310c9b8 tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] 10.222.0.115 "GET /compute/v2.1/servers/d2f5377c-09ed-45bc-b72e-ef00b95482ef" status: 200 len: 1318 microversion: 2.1 time: 0.236909 Aug 02 11:04:17.433479 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 504/1020] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:04:17 2022] GET /compute/v2.1/servers/d2f5377c-09ed-45bc-b72e-ef00b95482ef => generated 1318 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:04:18.460499 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG dbcounter [-] [129953] Writing DB stats nova_cell0:SELECT=8 {{(pid=129953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 11:04:18.464280 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-9828a185-b2ac-4251-80ca-96d14362aac4 tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:04:18.464898 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-9828a185-b2ac-4251-80ca-96d14362aac4 tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] [instance: d2f5377c-09ed-45bc-b72e-ef00b95482ef] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:04:18.473307 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-9828a185-b2ac-4251-80ca-96d14362aac4 tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:04:18.474078 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-9828a185-b2ac-4251-80ca-96d14362aac4 tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:04:18.475022 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-9828a185-b2ac-4251-80ca-96d14362aac4 tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:04:18.475632 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-9828a185-b2ac-4251-80ca-96d14362aac4 tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:04:18.627557 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-9828a185-b2ac-4251-80ca-96d14362aac4 tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab9773545044cbf8e6f0318fe649f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a92e65eb7546048be4b7c215257f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:04:18.635407 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-9828a185-b2ac-4251-80ca-96d14362aac4 tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] 10.222.0.115 "GET /compute/v2.1/servers/d2f5377c-09ed-45bc-b72e-ef00b95482ef" status: 200 len: 1318 microversion: 2.1 time: 0.176185 Aug 02 11:04:18.652528 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 517/1021] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:04:18 2022] GET /compute/v2.1/servers/d2f5377c-09ed-45bc-b72e-ef00b95482ef => generated 1318 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:04:19.658195 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-ee41c522-031b-4d18-9372-eb37d9d76b8f tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:04:19.658885 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-ee41c522-031b-4d18-9372-eb37d9d76b8f tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] [instance: d2f5377c-09ed-45bc-b72e-ef00b95482ef] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:04:19.669152 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-ee41c522-031b-4d18-9372-eb37d9d76b8f tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:04:19.669929 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-ee41c522-031b-4d18-9372-eb37d9d76b8f tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:04:19.670793 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-ee41c522-031b-4d18-9372-eb37d9d76b8f tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:04:19.671771 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-ee41c522-031b-4d18-9372-eb37d9d76b8f tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:04:19.885282 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-ee41c522-031b-4d18-9372-eb37d9d76b8f tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab9773545044cbf8e6f0318fe649f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a92e65eb7546048be4b7c215257f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:04:19.902866 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-ee41c522-031b-4d18-9372-eb37d9d76b8f tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] 10.222.0.115 "GET /compute/v2.1/servers/d2f5377c-09ed-45bc-b72e-ef00b95482ef" status: 200 len: 1318 microversion: 2.1 time: 0.248603 Aug 02 11:04:19.903785 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 505/1022] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:04:19 2022] GET /compute/v2.1/servers/d2f5377c-09ed-45bc-b72e-ef00b95482ef => generated 1318 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:04:20.264324 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-68676383-90c1-4164-83a9-b6b58d8307b7 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "11a3eee9-b897-4977-a6c7-b4ebcc040b4a", "device": "/dev/sdb"}} {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 11:04:20.267588 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-68676383-90c1-4164-83a9-b6b58d8307b7 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] [instance: 80d311f1-c318-410a-a86b-ec44b50b40ce] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:04:20.279615 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-68676383-90c1-4164-83a9-b6b58d8307b7 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:04:20.280347 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-68676383-90c1-4164-83a9-b6b58d8307b7 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:04:20.281560 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-68676383-90c1-4164-83a9-b6b58d8307b7 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:04:20.282215 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-68676383-90c1-4164-83a9-b6b58d8307b7 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:04:20.824682 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [req-f9363802-4844-4040-bae1-792ba521ecaf req-2430031b-f9bc-4a2f-a768-d7b012fe1e1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2f5377c-09ed-45bc-b72e-ef00b95482ef", "name": "network-vif-plugged", "status": "completed", "tag": "5ec36a51-91de-4277-a817-5bb6332c8d28"}]} {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 11:04:20.837625 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [req-f9363802-4844-4040-bae1-792ba521ecaf req-2430031b-f9bc-4a2f-a768-d7b012fe1e1e service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:04:20.840929 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [req-f9363802-4844-4040-bae1-792ba521ecaf req-2430031b-f9bc-4a2f-a768-d7b012fe1e1e service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:04:20.853649 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.compute.server_external_events [req-f9363802-4844-4040-bae1-792ba521ecaf req-2430031b-f9bc-4a2f-a768-d7b012fe1e1e service nova] Creating event network-vif-plugged:5ec36a51-91de-4277-a817-5bb6332c8d28 for instance d2f5377c-09ed-45bc-b72e-ef00b95482ef on hv-cinder-85031 Aug 02 11:04:20.860835 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [req-f9363802-4844-4040-bae1-792ba521ecaf req-2430031b-f9bc-4a2f-a768-d7b012fe1e1e service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040235 Aug 02 11:04:20.862357 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 506/1023] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Aug 2 11:04:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 11:04:20.928288 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-256bf7e1-3950-4a19-b641-623176d08c4b tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:04:20.929428 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-256bf7e1-3950-4a19-b641-623176d08c4b tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] [instance: d2f5377c-09ed-45bc-b72e-ef00b95482ef] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:04:20.947944 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-256bf7e1-3950-4a19-b641-623176d08c4b tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:04:20.948407 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-256bf7e1-3950-4a19-b641-623176d08c4b tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:04:20.949251 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-256bf7e1-3950-4a19-b641-623176d08c4b tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:04:20.949922 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-256bf7e1-3950-4a19-b641-623176d08c4b tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:04:21.177999 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-256bf7e1-3950-4a19-b641-623176d08c4b tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab9773545044cbf8e6f0318fe649f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a92e65eb7546048be4b7c215257f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:04:21.204405 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-256bf7e1-3950-4a19-b641-623176d08c4b tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] 10.222.0.115 "GET /compute/v2.1/servers/d2f5377c-09ed-45bc-b72e-ef00b95482ef" status: 200 len: 1318 microversion: 2.1 time: 0.282000 Aug 02 11:04:21.205558 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 507/1024] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:04:20 2022] GET /compute/v2.1/servers/d2f5377c-09ed-45bc-b72e-ef00b95482ef => generated 1318 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 11:04:21.414204 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-68676383-90c1-4164-83a9-b6b58d8307b7 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] 10.222.0.115 "POST /compute/v2.1/servers/80d311f1-c318-410a-a86b-ec44b50b40ce/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.154119 Aug 02 11:04:21.415528 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 518/1025] 10.222.0.115 () {60 vars in 1328 bytes} [Tue Aug 2 11:04:20 2022] POST /compute/v2.1/servers/80d311f1-c318-410a-a86b-ec44b50b40ce/os-volume_attachments => generated 194 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 11:04:22.237190 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-89d43ca6-f3eb-45f3-8dde-954d8d1389ff tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:04:22.237942 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-89d43ca6-f3eb-45f3-8dde-954d8d1389ff tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] [instance: d2f5377c-09ed-45bc-b72e-ef00b95482ef] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:04:22.255813 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-89d43ca6-f3eb-45f3-8dde-954d8d1389ff tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:04:22.255813 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-89d43ca6-f3eb-45f3-8dde-954d8d1389ff tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:04:22.255813 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-89d43ca6-f3eb-45f3-8dde-954d8d1389ff tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:04:22.255813 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-89d43ca6-f3eb-45f3-8dde-954d8d1389ff tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:04:22.467247 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-89d43ca6-f3eb-45f3-8dde-954d8d1389ff tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab9773545044cbf8e6f0318fe649f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a92e65eb7546048be4b7c215257f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:04:22.476607 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-89d43ca6-f3eb-45f3-8dde-954d8d1389ff tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] 10.222.0.115 "GET /compute/v2.1/servers/d2f5377c-09ed-45bc-b72e-ef00b95482ef" status: 200 len: 1318 microversion: 2.1 time: 0.248643 Aug 02 11:04:22.477811 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 508/1026] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:04:22 2022] GET /compute/v2.1/servers/d2f5377c-09ed-45bc-b72e-ef00b95482ef => generated 1318 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:04:23.600446 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-badce7b2-3b02-455f-8dc7-264cb52bd36a tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:04:23.600446 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-badce7b2-3b02-455f-8dc7-264cb52bd36a tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] [instance: d2f5377c-09ed-45bc-b72e-ef00b95482ef] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:04:23.600446 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-badce7b2-3b02-455f-8dc7-264cb52bd36a tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:04:23.600446 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-badce7b2-3b02-455f-8dc7-264cb52bd36a tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:04:23.601477 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-badce7b2-3b02-455f-8dc7-264cb52bd36a tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:04:23.601477 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-badce7b2-3b02-455f-8dc7-264cb52bd36a tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:04:23.715896 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-badce7b2-3b02-455f-8dc7-264cb52bd36a tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab9773545044cbf8e6f0318fe649f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a92e65eb7546048be4b7c215257f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:04:23.727328 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-badce7b2-3b02-455f-8dc7-264cb52bd36a tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] 10.222.0.115 "GET /compute/v2.1/servers/d2f5377c-09ed-45bc-b72e-ef00b95482ef" status: 200 len: 1468 microversion: 2.1 time: 0.231030 Aug 02 11:04:23.731861 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 519/1027] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:04:23 2022] GET /compute/v2.1/servers/d2f5377c-09ed-45bc-b72e-ef00b95482ef => generated 1468 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 11:04:23.790541 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-48880838-8346-442c-a931-3916ad49355b tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:04:23.791351 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-48880838-8346-442c-a931-3916ad49355b tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] [instance: d2f5377c-09ed-45bc-b72e-ef00b95482ef] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:04:23.794025 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG dbcounter [-] [129952] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=129952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 11:04:23.799479 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-48880838-8346-442c-a931-3916ad49355b tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:04:23.800990 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-48880838-8346-442c-a931-3916ad49355b tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:04:23.800990 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-48880838-8346-442c-a931-3916ad49355b tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:04:23.801234 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-48880838-8346-442c-a931-3916ad49355b tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:04:23.804392 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG dbcounter [-] [129952] Writing DB stats nova_cell1:SELECT=74,nova_cell1:INSERT=1 {{(pid=129952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 11:04:23.838682 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-48880838-8346-442c-a931-3916ad49355b tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] [instance: d2f5377c-09ed-45bc-b72e-ef00b95482ef] Going to try to terminate instance {{(pid=129952) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 11:04:24.444840 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-48880838-8346-442c-a931-3916ad49355b tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] 10.222.0.115 "DELETE /compute/v2.1/servers/d2f5377c-09ed-45bc-b72e-ef00b95482ef" status: 204 len: 0 microversion: 2.1 time: 0.658979 Aug 02 11:04:24.451167 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 509/1028] 10.222.0.115 () {58 vars in 1244 bytes} [Tue Aug 2 11:04:23 2022] DELETE /compute/v2.1/servers/d2f5377c-09ed-45bc-b72e-ef00b95482ef => generated 0 bytes in 661 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 11:04:24.455039 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-1ba3441d-0fb5-4efb-99eb-5ec99d0a5ed8 tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:04:24.455986 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-1ba3441d-0fb5-4efb-99eb-5ec99d0a5ed8 tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] [instance: d2f5377c-09ed-45bc-b72e-ef00b95482ef] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:04:24.464326 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-1ba3441d-0fb5-4efb-99eb-5ec99d0a5ed8 tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:04:24.465053 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-1ba3441d-0fb5-4efb-99eb-5ec99d0a5ed8 tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:04:24.466297 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-1ba3441d-0fb5-4efb-99eb-5ec99d0a5ed8 tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:04:24.466764 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-1ba3441d-0fb5-4efb-99eb-5ec99d0a5ed8 tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:04:24.643292 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-1ba3441d-0fb5-4efb-99eb-5ec99d0a5ed8 tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab9773545044cbf8e6f0318fe649f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a92e65eb7546048be4b7c215257f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:04:24.653794 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-1ba3441d-0fb5-4efb-99eb-5ec99d0a5ed8 tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] 10.222.0.115 "GET /compute/v2.1/servers/d2f5377c-09ed-45bc-b72e-ef00b95482ef" status: 200 len: 1474 microversion: 2.1 time: 0.203569 Aug 02 11:04:24.654729 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 520/1029] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:04:24 2022] GET /compute/v2.1/servers/d2f5377c-09ed-45bc-b72e-ef00b95482ef => generated 1474 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:04:25.679098 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-d461933c-26ad-457e-9a07-acaa017c46e0 tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:04:25.680944 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-d461933c-26ad-457e-9a07-acaa017c46e0 tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] [instance: d2f5377c-09ed-45bc-b72e-ef00b95482ef] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:04:25.694701 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-d461933c-26ad-457e-9a07-acaa017c46e0 tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:04:25.696246 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-d461933c-26ad-457e-9a07-acaa017c46e0 tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:04:25.698038 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-d461933c-26ad-457e-9a07-acaa017c46e0 tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:04:25.700245 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-d461933c-26ad-457e-9a07-acaa017c46e0 tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:04:25.935236 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-d461933c-26ad-457e-9a07-acaa017c46e0 tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab9773545044cbf8e6f0318fe649f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a92e65eb7546048be4b7c215257f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:04:25.949379 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-d461933c-26ad-457e-9a07-acaa017c46e0 tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] 10.222.0.115 "GET /compute/v2.1/servers/d2f5377c-09ed-45bc-b72e-ef00b95482ef" status: 200 len: 1474 microversion: 2.1 time: 0.275221 Aug 02 11:04:25.949989 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 510/1030] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:04:25 2022] GET /compute/v2.1/servers/d2f5377c-09ed-45bc-b72e-ef00b95482ef => generated 1474 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:04:26.979422 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-5df72cba-ff05-463f-9faf-eb0b8954ede8 tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:04:26.980053 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-5df72cba-ff05-463f-9faf-eb0b8954ede8 tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] [instance: d2f5377c-09ed-45bc-b72e-ef00b95482ef] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:04:26.988856 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG dbcounter [-] [129953] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=129953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 11:04:27.031193 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [req-e8c039e6-29b0-49ee-8f4e-f9725f339c4d req-547253c5-cc19-4a8a-910b-d15dab5e9111 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2f5377c-09ed-45bc-b72e-ef00b95482ef", "name": "network-vif-deleted", "tag": "5ec36a51-91de-4277-a817-5bb6332c8d28"}]} {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 11:04:27.031872 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-5df72cba-ff05-463f-9faf-eb0b8954ede8 tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:04:27.031872 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-5df72cba-ff05-463f-9faf-eb0b8954ede8 tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:04:27.031872 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-5df72cba-ff05-463f-9faf-eb0b8954ede8 tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:04:27.031872 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-5df72cba-ff05-463f-9faf-eb0b8954ede8 tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:04:27.032509 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [req-e8c039e6-29b0-49ee-8f4e-f9725f339c4d req-547253c5-cc19-4a8a-910b-d15dab5e9111 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:04:27.032509 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [req-e8c039e6-29b0-49ee-8f4e-f9725f339c4d req-547253c5-cc19-4a8a-910b-d15dab5e9111 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:04:27.046662 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.compute.server_external_events [req-e8c039e6-29b0-49ee-8f4e-f9725f339c4d req-547253c5-cc19-4a8a-910b-d15dab5e9111 service nova] Creating event network-vif-deleted:5ec36a51-91de-4277-a817-5bb6332c8d28 for instance d2f5377c-09ed-45bc-b72e-ef00b95482ef on hv-cinder-85031 Aug 02 11:04:27.055468 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [req-e8c039e6-29b0-49ee-8f4e-f9725f339c4d req-547253c5-cc19-4a8a-910b-d15dab5e9111 service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070003 Aug 02 11:04:27.071648 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 511/1031] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Aug 2 11:04:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 11:04:27.132901 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-5df72cba-ff05-463f-9faf-eb0b8954ede8 tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab9773545044cbf8e6f0318fe649f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a92e65eb7546048be4b7c215257f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:04:27.141880 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-5df72cba-ff05-463f-9faf-eb0b8954ede8 tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] 10.222.0.115 "GET /compute/v2.1/servers/d2f5377c-09ed-45bc-b72e-ef00b95482ef" status: 200 len: 1432 microversion: 2.1 time: 0.166708 Aug 02 11:04:27.156962 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 521/1032] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:04:26 2022] GET /compute/v2.1/servers/d2f5377c-09ed-45bc-b72e-ef00b95482ef => generated 1432 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:04:28.165487 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-77a1af4d-e92f-4239-93ce-887839a7c8c9 tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:04:28.166186 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-77a1af4d-e92f-4239-93ce-887839a7c8c9 tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] [instance: d2f5377c-09ed-45bc-b72e-ef00b95482ef] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:04:28.172760 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-77a1af4d-e92f-4239-93ce-887839a7c8c9 tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:04:28.173471 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-77a1af4d-e92f-4239-93ce-887839a7c8c9 tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:04:28.174540 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-77a1af4d-e92f-4239-93ce-887839a7c8c9 tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:04:28.175666 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-77a1af4d-e92f-4239-93ce-887839a7c8c9 tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:04:28.220498 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-77a1af4d-e92f-4239-93ce-887839a7c8c9 tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:04:28.221101 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-77a1af4d-e92f-4239-93ce-887839a7c8c9 tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:04:28.221552 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.objects.instance [None req-77a1af4d-e92f-4239-93ce-887839a7c8c9 tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Lazy-loading 'fault' on Instance uuid d2f5377c-09ed-45bc-b72e-ef00b95482ef {{(pid=129952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 11:04:28.290691 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-77a1af4d-e92f-4239-93ce-887839a7c8c9 tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab9773545044cbf8e6f0318fe649f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a92e65eb7546048be4b7c215257f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:04:28.299390 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-77a1af4d-e92f-4239-93ce-887839a7c8c9 tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] 10.222.0.115 "GET /compute/v2.1/servers/d2f5377c-09ed-45bc-b72e-ef00b95482ef" status: 200 len: 1308 microversion: 2.1 time: 0.138529 Aug 02 11:04:28.313206 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 512/1033] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:04:28 2022] GET /compute/v2.1/servers/d2f5377c-09ed-45bc-b72e-ef00b95482ef => generated 1308 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:04:29.399156 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-375f3052-3206-44b1-bc41-59264cbf3296 tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:04:29.399881 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-375f3052-3206-44b1-bc41-59264cbf3296 tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] [instance: d2f5377c-09ed-45bc-b72e-ef00b95482ef] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:04:29.406861 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-375f3052-3206-44b1-bc41-59264cbf3296 tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:04:29.407342 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-375f3052-3206-44b1-bc41-59264cbf3296 tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:04:29.408125 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-375f3052-3206-44b1-bc41-59264cbf3296 tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:04:29.408552 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-375f3052-3206-44b1-bc41-59264cbf3296 tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:04:29.426501 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.wsgi [None req-375f3052-3206-44b1-bc41-59264cbf3296 tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] HTTP exception thrown: Instance d2f5377c-09ed-45bc-b72e-ef00b95482ef could not be found. Aug 02 11:04:29.428296 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-375f3052-3206-44b1-bc41-59264cbf3296 tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Request method failure captured: Aug 02 11:04:29.428296 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: request: GET /compute/v2.1/servers/d2f5377c-09ed-45bc-b72e-ef00b95482ef HTTP/1.1 Aug 02 11:04:29.428296 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Accept: application/json Aug 02 11:04:29.428296 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Accept-Encoding: identity Aug 02 11:04:29.428296 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Connection: close Aug 02 11:04:29.428296 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Content-Length: 0 Aug 02 11:04:29.428296 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Content-Type: application/json Aug 02 11:04:29.428296 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Host: 10.222.0.115 Aug 02 11:04:29.428296 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Openstack-System-Scope: None Aug 02 11:04:29.428296 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: User-Agent: python-urllib3/1.26.10 Aug 02 11:04:29.428296 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Auth-Token: gAAAAABi6QShv9Ef2F_AcQ8NtiS9iCmRE2TtxkT_RZsO6UZj2xrWFx4jVnEotMlxv6p9XHDdtjBBbQ4gZzptsNS3aQZB7rOx6TXbO1nvuTMf8TpCnZArv16-BIIjUSPN9x-SLTxn_0Io_KZn6ds98MlYbvoi8BibYnCJlT5ohnWH9-GIuurfxjg Aug 02 11:04:29.428296 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Domain-Id: None Aug 02 11:04:29.428296 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Domain-Name: None Aug 02 11:04:29.428296 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Identity-Status: Confirmed Aug 02 11:04:29.428296 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Is-Admin-Project: True Aug 02 11:04:29.428296 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Project-Domain-Id: default Aug 02 11:04:29.428296 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Project-Domain-Name: Default Aug 02 11:04:29.428296 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Project-Id: 18a92e65eb7546048be4b7c215257f70 Aug 02 11:04:29.428296 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Project-Name: tempest-VolumesNegativeTest-1079463294 Aug 02 11:04:29.428296 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Role: reader,member Aug 02 11:04:29.428296 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Roles: reader,member Aug 02 11:04:29.429834 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/18a92e65eb7546048be4b7c215257f70"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2/18a92e65eb7546048be4b7c215257f70"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/18a92e65eb7546048be4b7c215257f70"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.115:8080", "publicURL": "http://10.222.0.115:8080/v1/AUTH_18a92e65eb7546048be4b7c215257f70"}]}] Aug 02 11:04:29.429834 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Tenant: tempest-VolumesNegativeTest-1079463294 Aug 02 11:04:29.429834 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Tenant-Id: 18a92e65eb7546048be4b7c215257f70 Aug 02 11:04:29.429834 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Tenant-Name: tempest-VolumesNegativeTest-1079463294 Aug 02 11:04:29.429834 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User: tempest-VolumesNegativeTest-1079463294-project Aug 02 11:04:29.429834 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User-Domain-Id: default Aug 02 11:04:29.429834 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User-Domain-Name: Default Aug 02 11:04:29.429834 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User-Id: 9ab9773545044cbf8e6f0318fe649f9d Aug 02 11:04:29.429834 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User-Name: tempest-VolumesNegativeTest-1079463294-project Aug 02 11:04:29.429834 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: method: > Aug 02 11:04:29.429834 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: exception: Instance d2f5377c-09ed-45bc-b72e-ef00b95482ef could not be found. Aug 02 11:04:29.429834 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: action_args: {'id': 'd2f5377c-09ed-45bc-b72e-ef00b95482ef'} Aug 02 11:04:29.431356 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 11:04:29.431356 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:04:29.431356 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 11:04:29.431356 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 11:04:29.431356 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 11:04:29.431356 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 11:04:29.431356 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 11:04:29.431356 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 11:04:29.431356 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 11:04:29.431356 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 11:04:29.431356 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2f5377c-09ed-45bc-b72e-ef00b95482ef could not be found. Aug 02 11:04:29.431356 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 11:04:29.431356 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 11:04:29.431356 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 11:04:29.431356 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:04:29.431356 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 11:04:29.431356 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 11:04:29.431356 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 11:04:29.431356 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 11:04:29.431356 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 11:04:29.432769 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 11:04:29.432769 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 11:04:29.432769 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 11:04:29.432769 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 11:04:29.432769 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 11:04:29.432769 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 11:04:29.432769 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 11:04:29.432769 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2f5377c-09ed-45bc-b72e-ef00b95482ef could not be found. Aug 02 11:04:29.432769 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 11:04:29.432769 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 11:04:29.432769 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 11:04:29.432769 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:04:29.432769 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 11:04:29.432769 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 11:04:29.432769 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 11:04:29.432769 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 11:04:29.432769 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2f5377c-09ed-45bc-b72e-ef00b95482ef could not be found. Aug 02 11:04:29.432769 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 11:04:29.434014 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-375f3052-3206-44b1-bc41-59264cbf3296 tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] Returning 404 to user: Instance d2f5377c-09ed-45bc-b72e-ef00b95482ef could not be found. {{(pid=129953) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 11:04:29.434014 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-375f3052-3206-44b1-bc41-59264cbf3296 tempest-VolumesNegativeTest-1079463294 tempest-VolumesNegativeTest-1079463294-project] 10.222.0.115 "GET /compute/v2.1/servers/d2f5377c-09ed-45bc-b72e-ef00b95482ef" status: 404 len: 111 microversion: 2.1 time: 0.034690 Aug 02 11:04:29.434014 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 522/1034] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:04:29 2022] GET /compute/v2.1/servers/d2f5377c-09ed-45bc-b72e-ef00b95482ef => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 11:04:52.834263 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-22de8517-654d-4d52-9ae6-469889c8ad40 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:04:52.834795 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-22de8517-654d-4d52-9ae6-469889c8ad40 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] [instance: 80d311f1-c318-410a-a86b-ec44b50b40ce] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:04:52.836975 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG dbcounter [-] [129952] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1 {{(pid=129952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 11:04:52.837761 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG dbcounter [-] [129952] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 11:04:52.842460 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-22de8517-654d-4d52-9ae6-469889c8ad40 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:04:52.847078 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-22de8517-654d-4d52-9ae6-469889c8ad40 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:04:52.847078 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-22de8517-654d-4d52-9ae6-469889c8ad40 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:04:52.847078 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-22de8517-654d-4d52-9ae6-469889c8ad40 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:04:52.929573 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.objects.instance [None req-22de8517-654d-4d52-9ae6-469889c8ad40 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lazy-loading 'services' on Instance uuid 80d311f1-c318-410a-a86b-ec44b50b40ce {{(pid=129952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 11:04:53.121422 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-22de8517-654d-4d52-9ae6-469889c8ad40 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] 10.222.0.115 "DELETE /compute/v2.1/servers/80d311f1-c318-410a-a86b-ec44b50b40ce/os-volume_attachments/11a3eee9-b897-4977-a6c7-b4ebcc040b4a" status: 202 len: 0 microversion: 2.1 time: 0.291145 Aug 02 11:04:53.122041 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 513/1035] 10.222.0.115 () {58 vars in 1421 bytes} [Tue Aug 2 11:04:52 2022] DELETE /compute/v2.1/servers/80d311f1-c318-410a-a86b-ec44b50b40ce/os-volume_attachments/11a3eee9-b897-4977-a6c7-b4ebcc040b4a => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 11:04:56.358863 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-cf78eb92-b8ec-41ec-b37b-ce60496337c1 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:04:56.359615 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-cf78eb92-b8ec-41ec-b37b-ce60496337c1 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] [instance: 80d311f1-c318-410a-a86b-ec44b50b40ce] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:04:56.361764 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG dbcounter [-] [129953] Writing DB stats nova_api:SELECT=3 {{(pid=129953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 11:04:56.362420 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG dbcounter [-] [129953] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 11:04:56.367899 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-cf78eb92-b8ec-41ec-b37b-ce60496337c1 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:04:56.368352 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-cf78eb92-b8ec-41ec-b37b-ce60496337c1 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:04:56.369118 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-cf78eb92-b8ec-41ec-b37b-ce60496337c1 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:04:56.369555 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-cf78eb92-b8ec-41ec-b37b-ce60496337c1 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:04:56.396199 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-cf78eb92-b8ec-41ec-b37b-ce60496337c1 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] [instance: 80d311f1-c318-410a-a86b-ec44b50b40ce] Going to try to terminate instance {{(pid=129953) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 11:04:56.757575 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-cf78eb92-b8ec-41ec-b37b-ce60496337c1 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] 10.222.0.115 "DELETE /compute/v2.1/servers/80d311f1-c318-410a-a86b-ec44b50b40ce" status: 204 len: 0 microversion: 2.1 time: 0.402440 Aug 02 11:04:56.758091 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 523/1036] 10.222.0.115 () {58 vars in 1244 bytes} [Tue Aug 2 11:04:56 2022] DELETE /compute/v2.1/servers/80d311f1-c318-410a-a86b-ec44b50b40ce => generated 0 bytes in 404 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 02 11:04:56.767504 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-b6debee5-b3a3-4570-83a2-d4ba0301c016 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:04:56.768468 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-b6debee5-b3a3-4570-83a2-d4ba0301c016 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] [instance: 80d311f1-c318-410a-a86b-ec44b50b40ce] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:04:56.774849 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-b6debee5-b3a3-4570-83a2-d4ba0301c016 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:04:56.775333 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-b6debee5-b3a3-4570-83a2-d4ba0301c016 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:04:56.776100 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-b6debee5-b3a3-4570-83a2-d4ba0301c016 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:04:56.776533 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-b6debee5-b3a3-4570-83a2-d4ba0301c016 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:04:57.098416 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-b6debee5-b3a3-4570-83a2-d4ba0301c016 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf80e69ea524d83ab199fc7315f4be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ebdffccaaa04484b32602a67fe23629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:04:57.106241 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-b6debee5-b3a3-4570-83a2-d4ba0301c016 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] 10.222.0.115 "GET /compute/v2.1/servers/80d311f1-c318-410a-a86b-ec44b50b40ce" status: 200 len: 1518 microversion: 2.1 time: 0.343692 Aug 02 11:04:57.106804 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 514/1037] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:04:56 2022] GET /compute/v2.1/servers/80d311f1-c318-410a-a86b-ec44b50b40ce => generated 1518 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:04:58.128504 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-f0db5f53-8aef-4e7c-8f04-5e2c7b177937 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:04:58.128900 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-f0db5f53-8aef-4e7c-8f04-5e2c7b177937 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] [instance: 80d311f1-c318-410a-a86b-ec44b50b40ce] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:04:58.135693 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-f0db5f53-8aef-4e7c-8f04-5e2c7b177937 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:04:58.136139 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-f0db5f53-8aef-4e7c-8f04-5e2c7b177937 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:04:58.136901 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-f0db5f53-8aef-4e7c-8f04-5e2c7b177937 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:04:58.137329 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-f0db5f53-8aef-4e7c-8f04-5e2c7b177937 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:04:58.325024 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-f0db5f53-8aef-4e7c-8f04-5e2c7b177937 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf80e69ea524d83ab199fc7315f4be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ebdffccaaa04484b32602a67fe23629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:04:58.332832 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-f0db5f53-8aef-4e7c-8f04-5e2c7b177937 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] 10.222.0.115 "GET /compute/v2.1/servers/80d311f1-c318-410a-a86b-ec44b50b40ce" status: 200 len: 1518 microversion: 2.1 time: 0.208919 Aug 02 11:04:58.333508 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 524/1038] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:04:58 2022] GET /compute/v2.1/servers/80d311f1-c318-410a-a86b-ec44b50b40ce => generated 1518 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:04:59.042883 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [req-c7c80d1c-3dd3-45d2-9321-01688a70c75a req-39fd31ec-bc86-4ffa-affa-60a2b77eaf96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80d311f1-c318-410a-a86b-ec44b50b40ce", "name": "network-vif-deleted", "tag": "c7069fe9-8652-4b41-ac2d-e70961003bff"}]} {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 11:04:59.053949 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [req-c7c80d1c-3dd3-45d2-9321-01688a70c75a req-39fd31ec-bc86-4ffa-affa-60a2b77eaf96 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:04:59.054282 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [req-c7c80d1c-3dd3-45d2-9321-01688a70c75a req-39fd31ec-bc86-4ffa-affa-60a2b77eaf96 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:04:59.067684 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.compute.server_external_events [req-c7c80d1c-3dd3-45d2-9321-01688a70c75a req-39fd31ec-bc86-4ffa-affa-60a2b77eaf96 service nova] Creating event network-vif-deleted:c7069fe9-8652-4b41-ac2d-e70961003bff for instance 80d311f1-c318-410a-a86b-ec44b50b40ce on hv-cinder-85031 Aug 02 11:04:59.073038 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [req-c7c80d1c-3dd3-45d2-9321-01688a70c75a req-39fd31ec-bc86-4ffa-affa-60a2b77eaf96 service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034834 Aug 02 11:04:59.073660 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 515/1039] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Aug 2 11:04:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 11:04:59.354518 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-5298644e-d6fe-46b6-8759-16e7b07f773b tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:04:59.355289 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-5298644e-d6fe-46b6-8759-16e7b07f773b tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] [instance: 80d311f1-c318-410a-a86b-ec44b50b40ce] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:04:59.362206 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-5298644e-d6fe-46b6-8759-16e7b07f773b tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:04:59.362904 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-5298644e-d6fe-46b6-8759-16e7b07f773b tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:04:59.366740 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-5298644e-d6fe-46b6-8759-16e7b07f773b tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:04:59.366740 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-5298644e-d6fe-46b6-8759-16e7b07f773b tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:04:59.395566 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-5298644e-d6fe-46b6-8759-16e7b07f773b tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:04:59.396513 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-5298644e-d6fe-46b6-8759-16e7b07f773b tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:04:59.396966 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.objects.instance [None req-5298644e-d6fe-46b6-8759-16e7b07f773b tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lazy-loading 'fault' on Instance uuid 80d311f1-c318-410a-a86b-ec44b50b40ce {{(pid=129953) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 11:04:59.439390 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-5298644e-d6fe-46b6-8759-16e7b07f773b tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf80e69ea524d83ab199fc7315f4be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ebdffccaaa04484b32602a67fe23629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:04:59.447551 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-5298644e-d6fe-46b6-8759-16e7b07f773b tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] 10.222.0.115 "GET /compute/v2.1/servers/80d311f1-c318-410a-a86b-ec44b50b40ce" status: 200 len: 1313 microversion: 2.1 time: 0.096931 Aug 02 11:04:59.448121 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 525/1040] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:04:59 2022] GET /compute/v2.1/servers/80d311f1-c318-410a-a86b-ec44b50b40ce => generated 1313 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:05:00.471079 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-2f06904a-40a5-48e2-80de-8a6d43909aaa tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:05:00.471781 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-2f06904a-40a5-48e2-80de-8a6d43909aaa tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] [instance: 80d311f1-c318-410a-a86b-ec44b50b40ce] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:05:00.478450 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-2f06904a-40a5-48e2-80de-8a6d43909aaa tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:05:00.478934 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-2f06904a-40a5-48e2-80de-8a6d43909aaa tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:05:00.479824 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-2f06904a-40a5-48e2-80de-8a6d43909aaa tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:05:00.480261 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-2f06904a-40a5-48e2-80de-8a6d43909aaa tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:05:00.494077 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.wsgi [None req-2f06904a-40a5-48e2-80de-8a6d43909aaa tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] HTTP exception thrown: Instance 80d311f1-c318-410a-a86b-ec44b50b40ce could not be found. Aug 02 11:05:00.495730 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-2f06904a-40a5-48e2-80de-8a6d43909aaa tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Request method failure captured: Aug 02 11:05:00.495730 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: request: GET /compute/v2.1/servers/80d311f1-c318-410a-a86b-ec44b50b40ce HTTP/1.1 Aug 02 11:05:00.495730 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Accept: application/json Aug 02 11:05:00.495730 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Accept-Encoding: identity Aug 02 11:05:00.495730 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Connection: close Aug 02 11:05:00.495730 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Content-Length: 0 Aug 02 11:05:00.495730 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Content-Type: application/json Aug 02 11:05:00.495730 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Host: 10.222.0.115 Aug 02 11:05:00.495730 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Openstack-System-Scope: None Aug 02 11:05:00.495730 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: User-Agent: python-urllib3/1.26.10 Aug 02 11:05:00.495730 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Auth-Token: gAAAAABi6QR4TYR5crXOZxj8FZbgjIaCX0kw6N2ktLpyNbf4U-HetefyQvb3T71yWDWrdyTMQUGPb_KY8Yz-6ZYCtqUHRIF-Ud02kIj1F37qpVFrL4Sr7UEFs41rQt1y0iWCmFqlSpVJHnfsWkGoncRfDpnNxqrv4hDmLvklb6KB2V_85BFu8Uw Aug 02 11:05:00.495730 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Domain-Id: None Aug 02 11:05:00.495730 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Domain-Name: None Aug 02 11:05:00.495730 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Identity-Status: Confirmed Aug 02 11:05:00.495730 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Is-Admin-Project: True Aug 02 11:05:00.495730 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Project-Domain-Id: default Aug 02 11:05:00.495730 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Project-Domain-Name: Default Aug 02 11:05:00.495730 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Project-Id: 1ebdffccaaa04484b32602a67fe23629 Aug 02 11:05:00.495730 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Project-Name: tempest-VolumesSnapshotTestJSON-463230268 Aug 02 11:05:00.495730 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Role: reader,member Aug 02 11:05:00.495730 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Roles: reader,member Aug 02 11:05:00.497490 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/1ebdffccaaa04484b32602a67fe23629"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2/1ebdffccaaa04484b32602a67fe23629"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/1ebdffccaaa04484b32602a67fe23629"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.115:8080", "publicURL": "http://10.222.0.115:8080/v1/AUTH_1ebdffccaaa04484b32602a67fe23629"}]}] Aug 02 11:05:00.497490 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Tenant: tempest-VolumesSnapshotTestJSON-463230268 Aug 02 11:05:00.497490 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Tenant-Id: 1ebdffccaaa04484b32602a67fe23629 Aug 02 11:05:00.497490 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-463230268 Aug 02 11:05:00.497490 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User: tempest-VolumesSnapshotTestJSON-463230268-project Aug 02 11:05:00.497490 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User-Domain-Id: default Aug 02 11:05:00.497490 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User-Domain-Name: Default Aug 02 11:05:00.497490 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User-Id: 6bf80e69ea524d83ab199fc7315f4be2 Aug 02 11:05:00.497490 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User-Name: tempest-VolumesSnapshotTestJSON-463230268-project Aug 02 11:05:00.497490 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: method: > Aug 02 11:05:00.497490 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: exception: Instance 80d311f1-c318-410a-a86b-ec44b50b40ce could not be found. Aug 02 11:05:00.497490 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: action_args: {'id': '80d311f1-c318-410a-a86b-ec44b50b40ce'} Aug 02 11:05:00.498558 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 11:05:00.498558 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:05:00.498558 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 11:05:00.498558 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 11:05:00.498558 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 11:05:00.498558 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 11:05:00.498558 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 11:05:00.498558 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 11:05:00.498558 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 11:05:00.498558 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 11:05:00.498558 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80d311f1-c318-410a-a86b-ec44b50b40ce could not be found. Aug 02 11:05:00.498558 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 11:05:00.498558 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 11:05:00.498558 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 11:05:00.498558 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:05:00.498558 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 11:05:00.498558 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 11:05:00.498558 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 11:05:00.498558 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 11:05:00.498558 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 11:05:00.500307 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 11:05:00.500307 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 11:05:00.500307 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 11:05:00.500307 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 11:05:00.500307 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 11:05:00.500307 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 11:05:00.500307 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 11:05:00.500307 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80d311f1-c318-410a-a86b-ec44b50b40ce could not be found. Aug 02 11:05:00.500307 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 11:05:00.500307 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 11:05:00.500307 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 11:05:00.500307 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:05:00.500307 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 11:05:00.500307 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 11:05:00.500307 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 11:05:00.500307 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 11:05:00.500307 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80d311f1-c318-410a-a86b-ec44b50b40ce could not be found. Aug 02 11:05:00.500307 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 11:05:00.501766 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-2f06904a-40a5-48e2-80de-8a6d43909aaa tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Returning 404 to user: Instance 80d311f1-c318-410a-a86b-ec44b50b40ce could not be found. {{(pid=129952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 11:05:00.501766 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-2f06904a-40a5-48e2-80de-8a6d43909aaa tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] 10.222.0.115 "GET /compute/v2.1/servers/80d311f1-c318-410a-a86b-ec44b50b40ce" status: 404 len: 111 microversion: 2.1 time: 0.030933 Aug 02 11:05:00.501766 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 516/1041] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:05:00 2022] GET /compute/v2.1/servers/80d311f1-c318-410a-a86b-ec44b50b40ce => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 11:05:10.115534 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 11:05:10.116125 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Tue Aug 2 11:05:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 11:05:10.946471 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-811ca0c6-e245-405f-8b40-ee3e92a0b791 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1536964883", "imageRef": "aa0a7b8c-0dd6-4803-8767-cb8c2d05fdd4", "flavorRef": "452", "networks": [{"uuid": "7deef5f7-3016-4b4c-9d6c-478898f91d61"}]}} {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 11:05:10.955102 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG dbcounter [-] [129953] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=129953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 11:05:10.955779 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG dbcounter [-] [129953] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 11:05:11.001539 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.network.neutron [None req-811ca0c6-e245-405f-8b40-ee3e92a0b791 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] validate_networks() for [('7deef5f7-3016-4b4c-9d6c-478898f91d61', None, None, None, None, None)] {{(pid=129953) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 11:05:11.355511 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.virt.hardware [None req-811ca0c6-e245-405f-8b40-ee3e92a0b791 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Flavor limits 0:0:0 {{(pid=129953) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 11:05:11.356130 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.virt.hardware [None req-811ca0c6-e245-405f-8b40-ee3e92a0b791 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Image limits 0:0:0 {{(pid=129953) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 11:05:11.356440 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.virt.hardware [None req-811ca0c6-e245-405f-8b40-ee3e92a0b791 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Flavor pref 0:0:0 {{(pid=129953) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 11:05:11.356864 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.virt.hardware [None req-811ca0c6-e245-405f-8b40-ee3e92a0b791 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Image pref 0:0:0 {{(pid=129953) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 11:05:11.357280 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.virt.hardware [None req-811ca0c6-e245-405f-8b40-ee3e92a0b791 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129953) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 11:05:11.366613 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-811ca0c6-e245-405f-8b40-ee3e92a0b791 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:05:11.367099 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-811ca0c6-e245-405f-8b40-ee3e92a0b791 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:05:11.370965 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-811ca0c6-e245-405f-8b40-ee3e92a0b791 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:05:11.370965 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-811ca0c6-e245-405f-8b40-ee3e92a0b791 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:05:11.386163 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.quota [None req-811ca0c6-e245-405f-8b40-ee3e92a0b791 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Getting quotas for project 1ebdffccaaa04484b32602a67fe23629. Resources: {'instances', 'cores', 'ram'} {{(pid=129953) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 11:05:11.390325 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.quota [None req-811ca0c6-e245-405f-8b40-ee3e92a0b791 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Getting quotas for user 6bf80e69ea524d83ab199fc7315f4be2 and project 1ebdffccaaa04484b32602a67fe23629. Resources: {'instances', 'cores', 'ram'} {{(pid=129953) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 11:05:11.402276 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-811ca0c6-e245-405f-8b40-ee3e92a0b791 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Going to run 1 instances... {{(pid=129953) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 11:05:11.404621 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-811ca0c6-e245-405f-8b40-ee3e92a0b791 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] [instance: 254f065c-8cf6-4766-bf43-c1929792695a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aa0a7b8c-0dd6-4803-8767-cb8c2d05fdd4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129953) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 11:05:11.543642 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-811ca0c6-e245-405f-8b40-ee3e92a0b791 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] 10.222.0.115 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.601372 Aug 02 11:05:11.550622 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 526/1042] 10.222.0.115 () {60 vars in 1152 bytes} [Tue Aug 2 11:05:10 2022] POST /compute/v2.1/servers => generated 382 bytes in 604 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 02 11:05:11.557196 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-74edb52f-d54f-474b-9e06-0e3848a3d66e tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:05:11.557808 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-74edb52f-d54f-474b-9e06-0e3848a3d66e tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] [instance: 254f065c-8cf6-4766-bf43-c1929792695a] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:05:11.560150 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG dbcounter [-] [129952] Writing DB stats nova_api:SELECT=8 {{(pid=129952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 11:05:11.560806 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG dbcounter [-] [129952] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=129952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 11:05:11.617165 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-74edb52f-d54f-474b-9e06-0e3848a3d66e tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf80e69ea524d83ab199fc7315f4be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ebdffccaaa04484b32602a67fe23629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:05:11.624966 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-74edb52f-d54f-474b-9e06-0e3848a3d66e tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] 10.222.0.115 "GET /compute/v2.1/servers/254f065c-8cf6-4766-bf43-c1929792695a" status: 200 len: 1223 microversion: 2.1 time: 0.072812 Aug 02 11:05:11.625543 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 517/1043] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:05:11 2022] GET /compute/v2.1/servers/254f065c-8cf6-4766-bf43-c1929792695a => generated 1223 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:05:12.426639 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 11:05:12.426868 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Tue Aug 2 11:05:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 11:05:12.646608 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-93ccc65e-02b9-40b0-84e6-1d7164f1cc9c tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:05:12.647256 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-93ccc65e-02b9-40b0-84e6-1d7164f1cc9c tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] [instance: 254f065c-8cf6-4766-bf43-c1929792695a] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:05:12.654260 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-93ccc65e-02b9-40b0-84e6-1d7164f1cc9c tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:05:12.654713 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-93ccc65e-02b9-40b0-84e6-1d7164f1cc9c tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:05:12.655509 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-93ccc65e-02b9-40b0-84e6-1d7164f1cc9c tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:05:12.656412 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-93ccc65e-02b9-40b0-84e6-1d7164f1cc9c tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:05:12.718801 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-93ccc65e-02b9-40b0-84e6-1d7164f1cc9c tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf80e69ea524d83ab199fc7315f4be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ebdffccaaa04484b32602a67fe23629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:05:12.726581 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-93ccc65e-02b9-40b0-84e6-1d7164f1cc9c tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] 10.222.0.115 "GET /compute/v2.1/servers/254f065c-8cf6-4766-bf43-c1929792695a" status: 200 len: 1227 microversion: 2.1 time: 0.084639 Aug 02 11:05:12.727210 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 527/1044] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:05:12 2022] GET /compute/v2.1/servers/254f065c-8cf6-4766-bf43-c1929792695a => generated 1227 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:05:13.748048 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-dcf5864c-eff1-4c17-90c0-7679caf507f9 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:05:13.748670 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-dcf5864c-eff1-4c17-90c0-7679caf507f9 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] [instance: 254f065c-8cf6-4766-bf43-c1929792695a] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:05:13.756787 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-dcf5864c-eff1-4c17-90c0-7679caf507f9 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:05:13.758134 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-dcf5864c-eff1-4c17-90c0-7679caf507f9 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:05:13.759312 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-dcf5864c-eff1-4c17-90c0-7679caf507f9 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:05:13.759916 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-dcf5864c-eff1-4c17-90c0-7679caf507f9 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:05:13.838420 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-dcf5864c-eff1-4c17-90c0-7679caf507f9 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf80e69ea524d83ab199fc7315f4be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ebdffccaaa04484b32602a67fe23629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:05:13.846041 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-dcf5864c-eff1-4c17-90c0-7679caf507f9 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] 10.222.0.115 "GET /compute/v2.1/servers/254f065c-8cf6-4766-bf43-c1929792695a" status: 200 len: 1281 microversion: 2.1 time: 0.101785 Aug 02 11:05:13.846694 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 518/1045] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:05:13 2022] GET /compute/v2.1/servers/254f065c-8cf6-4766-bf43-c1929792695a => generated 1281 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:05:14.873715 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-3e80a615-f1ec-4cb7-b3b3-9a06fb46d80b tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:05:14.874402 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-3e80a615-f1ec-4cb7-b3b3-9a06fb46d80b tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] [instance: 254f065c-8cf6-4766-bf43-c1929792695a] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:05:14.881497 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-3e80a615-f1ec-4cb7-b3b3-9a06fb46d80b tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:05:14.881961 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-3e80a615-f1ec-4cb7-b3b3-9a06fb46d80b tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:05:14.883743 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-3e80a615-f1ec-4cb7-b3b3-9a06fb46d80b tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:05:14.884210 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-3e80a615-f1ec-4cb7-b3b3-9a06fb46d80b tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:05:15.163319 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-3e80a615-f1ec-4cb7-b3b3-9a06fb46d80b tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf80e69ea524d83ab199fc7315f4be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ebdffccaaa04484b32602a67fe23629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:05:15.172153 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-3e80a615-f1ec-4cb7-b3b3-9a06fb46d80b tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] 10.222.0.115 "GET /compute/v2.1/servers/254f065c-8cf6-4766-bf43-c1929792695a" status: 200 len: 1323 microversion: 2.1 time: 0.302779 Aug 02 11:05:15.172739 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 528/1046] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:05:14 2022] GET /compute/v2.1/servers/254f065c-8cf6-4766-bf43-c1929792695a => generated 1323 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 11:05:15.298659 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [req-b5100b54-7356-40ce-84d0-e48bcd25fedf req-5089179a-d3d5-44e6-9b5a-9e02169b1112 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "254f065c-8cf6-4766-bf43-c1929792695a", "tag": "93ea59a4-4874-4f7c-a534-57202be12e2b"}]} {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 11:05:15.313269 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [req-b5100b54-7356-40ce-84d0-e48bcd25fedf req-5089179a-d3d5-44e6-9b5a-9e02169b1112 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:05:15.313728 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [req-b5100b54-7356-40ce-84d0-e48bcd25fedf req-5089179a-d3d5-44e6-9b5a-9e02169b1112 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:05:15.325989 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.compute.server_external_events [req-b5100b54-7356-40ce-84d0-e48bcd25fedf req-5089179a-d3d5-44e6-9b5a-9e02169b1112 service nova] Creating event network-changed:93ea59a4-4874-4f7c-a534-57202be12e2b for instance 254f065c-8cf6-4766-bf43-c1929792695a on hv-cinder-85031 Aug 02 11:05:15.331810 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [req-b5100b54-7356-40ce-84d0-e48bcd25fedf req-5089179a-d3d5-44e6-9b5a-9e02169b1112 service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037204 Aug 02 11:05:15.332409 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 519/1047] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Aug 2 11:05:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 11:05:15.580970 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-740464e7-906b-410c-8564-d008da2d28bd tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:05:15.581703 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-740464e7-906b-410c-8564-d008da2d28bd tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] [instance: fd09d54f-4850-44ab-b2e8-f58a339680b1] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:05:15.584911 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [req-9303ed3c-2412-4dcb-9236-dd60ba455c3e req-1532b0cb-ac3d-4c13-a089-bdc99cbb9bb8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd09d54f-4850-44ab-b2e8-f58a339680b1", "tag": "0152f1cc-99ed-464f-a9fb-213142a00fb8"}]} {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 11:05:15.594205 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-740464e7-906b-410c-8564-d008da2d28bd tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:05:15.595074 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-740464e7-906b-410c-8564-d008da2d28bd tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:05:15.599392 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-740464e7-906b-410c-8564-d008da2d28bd tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:05:15.599879 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-740464e7-906b-410c-8564-d008da2d28bd tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:05:15.601597 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [req-9303ed3c-2412-4dcb-9236-dd60ba455c3e req-1532b0cb-ac3d-4c13-a089-bdc99cbb9bb8 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:05:15.606802 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [req-9303ed3c-2412-4dcb-9236-dd60ba455c3e req-1532b0cb-ac3d-4c13-a089-bdc99cbb9bb8 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:05:15.629117 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.compute.server_external_events [req-9303ed3c-2412-4dcb-9236-dd60ba455c3e req-1532b0cb-ac3d-4c13-a089-bdc99cbb9bb8 service nova] Creating event network-changed:0152f1cc-99ed-464f-a9fb-213142a00fb8 for instance fd09d54f-4850-44ab-b2e8-f58a339680b1 on hv-cinder-85031 Aug 02 11:05:15.635969 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [req-9303ed3c-2412-4dcb-9236-dd60ba455c3e req-1532b0cb-ac3d-4c13-a089-bdc99cbb9bb8 service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056329 Aug 02 11:05:15.637271 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 520/1048] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Aug 2 11:05:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 11:05:15.668951 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-740464e7-906b-410c-8564-d008da2d28bd tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] [instance: fd09d54f-4850-44ab-b2e8-f58a339680b1] Going to try to terminate instance {{(pid=129953) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 11:05:16.027177 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-740464e7-906b-410c-8564-d008da2d28bd tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] 10.222.0.115 "DELETE /compute/v2.1/servers/fd09d54f-4850-44ab-b2e8-f58a339680b1" status: 204 len: 0 microversion: 2.1 time: 0.452097 Aug 02 11:05:16.037772 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 529/1049] 10.222.0.115 () {58 vars in 1244 bytes} [Tue Aug 2 11:05:15 2022] DELETE /compute/v2.1/servers/fd09d54f-4850-44ab-b2e8-f58a339680b1 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 11:05:16.040068 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-f123ac65-23e6-4cbc-b23f-4b784c4add7a tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:05:16.041467 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-f123ac65-23e6-4cbc-b23f-4b784c4add7a tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] [instance: fd09d54f-4850-44ab-b2e8-f58a339680b1] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:05:16.048069 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-f123ac65-23e6-4cbc-b23f-4b784c4add7a tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:05:16.048674 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-f123ac65-23e6-4cbc-b23f-4b784c4add7a tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:05:16.049628 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-f123ac65-23e6-4cbc-b23f-4b784c4add7a tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:05:16.050077 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-f123ac65-23e6-4cbc-b23f-4b784c4add7a tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:05:16.194739 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-9a8f293d-7159-421e-bd19-cb0c39be12e0 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:05:16.196102 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-9a8f293d-7159-421e-bd19-cb0c39be12e0 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] [instance: 254f065c-8cf6-4766-bf43-c1929792695a] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:05:16.204055 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-9a8f293d-7159-421e-bd19-cb0c39be12e0 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:05:16.205124 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-9a8f293d-7159-421e-bd19-cb0c39be12e0 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:05:16.206255 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-9a8f293d-7159-421e-bd19-cb0c39be12e0 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:05:16.206872 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-9a8f293d-7159-421e-bd19-cb0c39be12e0 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:05:16.225917 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-f123ac65-23e6-4cbc-b23f-4b784c4add7a tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914de37664914b4cb91e0ce2c3a0e1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66234794284419a47e3afcae968084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:05:16.235387 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-f123ac65-23e6-4cbc-b23f-4b784c4add7a tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] 10.222.0.115 "GET /compute/v2.1/servers/fd09d54f-4850-44ab-b2e8-f58a339680b1" status: 200 len: 1580 microversion: 2.1 time: 0.200920 Aug 02 11:05:16.236605 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 521/1050] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:05:16 2022] GET /compute/v2.1/servers/fd09d54f-4850-44ab-b2e8-f58a339680b1 => generated 1580 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:05:16.365793 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-9a8f293d-7159-421e-bd19-cb0c39be12e0 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf80e69ea524d83ab199fc7315f4be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ebdffccaaa04484b32602a67fe23629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:05:16.374069 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-9a8f293d-7159-421e-bd19-cb0c39be12e0 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] 10.222.0.115 "GET /compute/v2.1/servers/254f065c-8cf6-4766-bf43-c1929792695a" status: 200 len: 1323 microversion: 2.1 time: 0.183971 Aug 02 11:05:16.374898 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 530/1051] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:05:16 2022] GET /compute/v2.1/servers/254f065c-8cf6-4766-bf43-c1929792695a => generated 1323 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 11:05:17.262452 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-eaf69829-35ed-4bc0-bea1-cd7dc0d22b8f tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:05:17.263259 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-eaf69829-35ed-4bc0-bea1-cd7dc0d22b8f tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] [instance: fd09d54f-4850-44ab-b2e8-f58a339680b1] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:05:17.271897 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-eaf69829-35ed-4bc0-bea1-cd7dc0d22b8f tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:05:17.272350 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-eaf69829-35ed-4bc0-bea1-cd7dc0d22b8f tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:05:17.273379 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-eaf69829-35ed-4bc0-bea1-cd7dc0d22b8f tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:05:17.273825 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-eaf69829-35ed-4bc0-bea1-cd7dc0d22b8f tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:05:17.394229 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-7a753906-8621-4042-a1c6-1be041ae5c86 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:05:17.394844 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-7a753906-8621-4042-a1c6-1be041ae5c86 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] [instance: 254f065c-8cf6-4766-bf43-c1929792695a] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:05:17.402089 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-7a753906-8621-4042-a1c6-1be041ae5c86 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:05:17.403028 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-7a753906-8621-4042-a1c6-1be041ae5c86 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:05:17.404105 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-7a753906-8621-4042-a1c6-1be041ae5c86 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:05:17.405043 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-7a753906-8621-4042-a1c6-1be041ae5c86 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:05:17.425792 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-eaf69829-35ed-4bc0-bea1-cd7dc0d22b8f tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914de37664914b4cb91e0ce2c3a0e1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66234794284419a47e3afcae968084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:05:17.437003 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-eaf69829-35ed-4bc0-bea1-cd7dc0d22b8f tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] 10.222.0.115 "GET /compute/v2.1/servers/fd09d54f-4850-44ab-b2e8-f58a339680b1" status: 200 len: 1580 microversion: 2.1 time: 0.179785 Aug 02 11:05:17.437873 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 522/1052] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:05:17 2022] GET /compute/v2.1/servers/fd09d54f-4850-44ab-b2e8-f58a339680b1 => generated 1580 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:05:17.545536 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-7a753906-8621-4042-a1c6-1be041ae5c86 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf80e69ea524d83ab199fc7315f4be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ebdffccaaa04484b32602a67fe23629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:05:17.554584 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-7a753906-8621-4042-a1c6-1be041ae5c86 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] 10.222.0.115 "GET /compute/v2.1/servers/254f065c-8cf6-4766-bf43-c1929792695a" status: 200 len: 1323 microversion: 2.1 time: 0.164384 Aug 02 11:05:17.555670 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 531/1053] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:05:17 2022] GET /compute/v2.1/servers/254f065c-8cf6-4766-bf43-c1929792695a => generated 1323 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 11:05:18.466555 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-7577277a-1177-4156-8f15-1a46aa848da9 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:05:18.467200 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-7577277a-1177-4156-8f15-1a46aa848da9 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] [instance: fd09d54f-4850-44ab-b2e8-f58a339680b1] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:05:18.473868 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-7577277a-1177-4156-8f15-1a46aa848da9 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:05:18.474315 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-7577277a-1177-4156-8f15-1a46aa848da9 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:05:18.475097 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-7577277a-1177-4156-8f15-1a46aa848da9 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:05:18.475530 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-7577277a-1177-4156-8f15-1a46aa848da9 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:05:18.577219 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-2a147312-af9f-4be4-8400-43bc4472a894 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:05:18.578119 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-2a147312-af9f-4be4-8400-43bc4472a894 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] [instance: 254f065c-8cf6-4766-bf43-c1929792695a] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:05:18.585721 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-2a147312-af9f-4be4-8400-43bc4472a894 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:05:18.586208 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-2a147312-af9f-4be4-8400-43bc4472a894 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:05:18.587641 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-2a147312-af9f-4be4-8400-43bc4472a894 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:05:18.588087 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-2a147312-af9f-4be4-8400-43bc4472a894 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:05:18.625761 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-7577277a-1177-4156-8f15-1a46aa848da9 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914de37664914b4cb91e0ce2c3a0e1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66234794284419a47e3afcae968084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:05:18.636691 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-7577277a-1177-4156-8f15-1a46aa848da9 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] 10.222.0.115 "GET /compute/v2.1/servers/fd09d54f-4850-44ab-b2e8-f58a339680b1" status: 200 len: 1462 microversion: 2.1 time: 0.173894 Aug 02 11:05:18.637755 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 523/1054] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:05:18 2022] GET /compute/v2.1/servers/fd09d54f-4850-44ab-b2e8-f58a339680b1 => generated 1462 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 11:05:18.736550 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-2a147312-af9f-4be4-8400-43bc4472a894 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf80e69ea524d83ab199fc7315f4be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ebdffccaaa04484b32602a67fe23629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:05:18.745000 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-2a147312-af9f-4be4-8400-43bc4472a894 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] 10.222.0.115 "GET /compute/v2.1/servers/254f065c-8cf6-4766-bf43-c1929792695a" status: 200 len: 1323 microversion: 2.1 time: 0.171691 Aug 02 11:05:18.745578 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 532/1055] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:05:18 2022] GET /compute/v2.1/servers/254f065c-8cf6-4766-bf43-c1929792695a => generated 1323 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 11:05:18.949078 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [req-f48449ee-d928-479d-bb26-7d130bd9fbba req-8c55e44a-995f-41d0-b3bd-207ad1541f48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd09d54f-4850-44ab-b2e8-f58a339680b1", "name": "network-vif-deleted", "tag": "0152f1cc-99ed-464f-a9fb-213142a00fb8"}]} {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 11:05:18.959924 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [req-f48449ee-d928-479d-bb26-7d130bd9fbba req-8c55e44a-995f-41d0-b3bd-207ad1541f48 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:05:18.960375 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [req-f48449ee-d928-479d-bb26-7d130bd9fbba req-8c55e44a-995f-41d0-b3bd-207ad1541f48 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:05:18.975011 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.compute.server_external_events [req-f48449ee-d928-479d-bb26-7d130bd9fbba req-8c55e44a-995f-41d0-b3bd-207ad1541f48 service nova] Creating event network-vif-deleted:0152f1cc-99ed-464f-a9fb-213142a00fb8 for instance fd09d54f-4850-44ab-b2e8-f58a339680b1 on hv-cinder-85031 Aug 02 11:05:18.981144 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [req-f48449ee-d928-479d-bb26-7d130bd9fbba req-8c55e44a-995f-41d0-b3bd-207ad1541f48 service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036633 Aug 02 11:05:18.981745 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 524/1056] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Aug 2 11:05:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 11:05:19.658654 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-fe069280-1e2a-4909-b960-eaa701319b3b tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:05:19.659255 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-fe069280-1e2a-4909-b960-eaa701319b3b tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] [instance: fd09d54f-4850-44ab-b2e8-f58a339680b1] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:05:19.666048 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-fe069280-1e2a-4909-b960-eaa701319b3b tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:05:19.666487 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-fe069280-1e2a-4909-b960-eaa701319b3b tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:05:19.667273 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-fe069280-1e2a-4909-b960-eaa701319b3b tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:05:19.667706 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-fe069280-1e2a-4909-b960-eaa701319b3b tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:05:19.700429 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-fe069280-1e2a-4909-b960-eaa701319b3b tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:05:19.700866 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-fe069280-1e2a-4909-b960-eaa701319b3b tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:05:19.701311 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.objects.instance [None req-fe069280-1e2a-4909-b960-eaa701319b3b tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lazy-loading 'fault' on Instance uuid fd09d54f-4850-44ab-b2e8-f58a339680b1 {{(pid=129953) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 11:05:19.742852 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-fe069280-1e2a-4909-b960-eaa701319b3b tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914de37664914b4cb91e0ce2c3a0e1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66234794284419a47e3afcae968084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:05:19.750499 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-fe069280-1e2a-4909-b960-eaa701319b3b tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] 10.222.0.115 "GET /compute/v2.1/servers/fd09d54f-4850-44ab-b2e8-f58a339680b1" status: 200 len: 1234 microversion: 2.1 time: 0.095880 Aug 02 11:05:19.751181 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 533/1057] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:05:19 2022] GET /compute/v2.1/servers/fd09d54f-4850-44ab-b2e8-f58a339680b1 => generated 1234 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:05:19.766240 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-ba74097d-2461-4c0d-a6a5-5ea2ab18dffd tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:05:19.766940 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-ba74097d-2461-4c0d-a6a5-5ea2ab18dffd tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] [instance: 254f065c-8cf6-4766-bf43-c1929792695a] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:05:19.774459 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-ba74097d-2461-4c0d-a6a5-5ea2ab18dffd tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:05:19.774906 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-ba74097d-2461-4c0d-a6a5-5ea2ab18dffd tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:05:19.775722 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-ba74097d-2461-4c0d-a6a5-5ea2ab18dffd tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:05:19.776156 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-ba74097d-2461-4c0d-a6a5-5ea2ab18dffd tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:05:19.910138 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-ba74097d-2461-4c0d-a6a5-5ea2ab18dffd tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf80e69ea524d83ab199fc7315f4be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ebdffccaaa04484b32602a67fe23629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:05:19.918209 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-ba74097d-2461-4c0d-a6a5-5ea2ab18dffd tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] 10.222.0.115 "GET /compute/v2.1/servers/254f065c-8cf6-4766-bf43-c1929792695a" status: 200 len: 1323 microversion: 2.1 time: 0.156260 Aug 02 11:05:19.918766 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 525/1058] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:05:19 2022] GET /compute/v2.1/servers/254f065c-8cf6-4766-bf43-c1929792695a => generated 1323 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:05:20.771981 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-81c42724-89e3-407a-a776-ca937f3d60fd tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:05:20.772658 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-81c42724-89e3-407a-a776-ca937f3d60fd tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] [instance: fd09d54f-4850-44ab-b2e8-f58a339680b1] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:05:20.779928 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-81c42724-89e3-407a-a776-ca937f3d60fd tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:05:20.786683 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-81c42724-89e3-407a-a776-ca937f3d60fd tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:05:20.786683 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-81c42724-89e3-407a-a776-ca937f3d60fd tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:05:20.786683 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-81c42724-89e3-407a-a776-ca937f3d60fd tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:05:20.799153 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.wsgi [None req-81c42724-89e3-407a-a776-ca937f3d60fd tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] HTTP exception thrown: Instance fd09d54f-4850-44ab-b2e8-f58a339680b1 could not be found. Aug 02 11:05:20.802245 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-81c42724-89e3-407a-a776-ca937f3d60fd tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Request method failure captured: Aug 02 11:05:20.802245 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: request: GET /compute/v2.1/servers/fd09d54f-4850-44ab-b2e8-f58a339680b1 HTTP/1.1 Aug 02 11:05:20.802245 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Accept: application/json Aug 02 11:05:20.802245 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Accept-Encoding: identity Aug 02 11:05:20.802245 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Connection: close Aug 02 11:05:20.802245 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Content-Length: 0 Aug 02 11:05:20.802245 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Content-Type: application/json Aug 02 11:05:20.802245 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Host: 10.222.0.115 Aug 02 11:05:20.802245 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Openstack-System-Scope: None Aug 02 11:05:20.802245 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: User-Agent: python-urllib3/1.26.10 Aug 02 11:05:20.802245 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Auth-Token: gAAAAABi6QLq99om1OPWk1UijdLFE4rJ9tpb2cZBQAHRTgACTzCFftT30PxRbh5RhDYBxLkgEX_E-dzDxhNIcBXD70mTnMHeO4WPGCOlL9LKe34lSDb6brF9YXse81gOOuIm6GWNmPlYen1_XTIBq7GyPb3kwWB2BtnBJaDfo20Av8axtorTXVA Aug 02 11:05:20.802245 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Domain-Id: None Aug 02 11:05:20.802245 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Domain-Name: None Aug 02 11:05:20.802245 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Identity-Status: Confirmed Aug 02 11:05:20.802245 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Is-Admin-Project: True Aug 02 11:05:20.802245 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Project-Domain-Id: default Aug 02 11:05:20.802245 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Project-Domain-Name: Default Aug 02 11:05:20.802245 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Project-Id: be66234794284419a47e3afcae968084 Aug 02 11:05:20.802245 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Project-Name: tempest-TestVolumeBootPattern-1859072211 Aug 02 11:05:20.802245 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Role: reader,member Aug 02 11:05:20.802245 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Roles: reader,member Aug 02 11:05:20.804103 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/be66234794284419a47e3afcae968084"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2/be66234794284419a47e3afcae968084"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/be66234794284419a47e3afcae968084"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.115:8080", "publicURL": "http://10.222.0.115:8080/v1/AUTH_be66234794284419a47e3afcae968084"}]}] Aug 02 11:05:20.804103 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Tenant: tempest-TestVolumeBootPattern-1859072211 Aug 02 11:05:20.804103 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Tenant-Id: be66234794284419a47e3afcae968084 Aug 02 11:05:20.804103 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Tenant-Name: tempest-TestVolumeBootPattern-1859072211 Aug 02 11:05:20.804103 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User: tempest-TestVolumeBootPattern-1859072211-project Aug 02 11:05:20.804103 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User-Domain-Id: default Aug 02 11:05:20.804103 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User-Domain-Name: Default Aug 02 11:05:20.804103 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User-Id: 914de37664914b4cb91e0ce2c3a0e1d1 Aug 02 11:05:20.804103 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User-Name: tempest-TestVolumeBootPattern-1859072211-project Aug 02 11:05:20.804103 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: method: > Aug 02 11:05:20.804103 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: exception: Instance fd09d54f-4850-44ab-b2e8-f58a339680b1 could not be found. Aug 02 11:05:20.804103 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: action_args: {'id': 'fd09d54f-4850-44ab-b2e8-f58a339680b1'} Aug 02 11:05:20.805723 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 11:05:20.805723 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:05:20.805723 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 11:05:20.805723 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 11:05:20.805723 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 11:05:20.805723 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 11:05:20.805723 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 11:05:20.805723 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 11:05:20.805723 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 11:05:20.805723 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 11:05:20.805723 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd09d54f-4850-44ab-b2e8-f58a339680b1 could not be found. Aug 02 11:05:20.805723 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 11:05:20.805723 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 11:05:20.805723 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 11:05:20.805723 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:05:20.805723 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 11:05:20.805723 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 11:05:20.805723 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 11:05:20.805723 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 11:05:20.805723 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 11:05:20.807420 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 11:05:20.807420 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 11:05:20.807420 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 11:05:20.807420 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 11:05:20.807420 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 11:05:20.807420 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 11:05:20.807420 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 11:05:20.807420 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd09d54f-4850-44ab-b2e8-f58a339680b1 could not be found. Aug 02 11:05:20.807420 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 11:05:20.807420 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 11:05:20.807420 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 11:05:20.807420 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:05:20.807420 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 11:05:20.807420 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 11:05:20.807420 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 11:05:20.807420 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 11:05:20.807420 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd09d54f-4850-44ab-b2e8-f58a339680b1 could not be found. Aug 02 11:05:20.807420 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 11:05:20.808941 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-81c42724-89e3-407a-a776-ca937f3d60fd tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Returning 404 to user: Instance fd09d54f-4850-44ab-b2e8-f58a339680b1 could not be found. {{(pid=129953) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 11:05:20.808941 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-81c42724-89e3-407a-a776-ca937f3d60fd tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] 10.222.0.115 "GET /compute/v2.1/servers/fd09d54f-4850-44ab-b2e8-f58a339680b1" status: 404 len: 111 microversion: 2.1 time: 0.036139 Aug 02 11:05:20.808941 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 534/1059] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:05:20 2022] GET /compute/v2.1/servers/fd09d54f-4850-44ab-b2e8-f58a339680b1 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 11:05:20.939019 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-a69f3c52-abbe-4610-9480-26eed5dc1805 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:05:20.939836 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-a69f3c52-abbe-4610-9480-26eed5dc1805 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] [instance: 254f065c-8cf6-4766-bf43-c1929792695a] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:05:20.948797 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-a69f3c52-abbe-4610-9480-26eed5dc1805 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:05:20.949251 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-a69f3c52-abbe-4610-9480-26eed5dc1805 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:05:20.950072 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-a69f3c52-abbe-4610-9480-26eed5dc1805 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:05:20.950528 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-a69f3c52-abbe-4610-9480-26eed5dc1805 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:05:21.104724 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-a69f3c52-abbe-4610-9480-26eed5dc1805 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf80e69ea524d83ab199fc7315f4be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ebdffccaaa04484b32602a67fe23629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:05:21.112784 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-a69f3c52-abbe-4610-9480-26eed5dc1805 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] 10.222.0.115 "GET /compute/v2.1/servers/254f065c-8cf6-4766-bf43-c1929792695a" status: 200 len: 1323 microversion: 2.1 time: 0.177776 Aug 02 11:05:21.118367 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 526/1060] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:05:20 2022] GET /compute/v2.1/servers/254f065c-8cf6-4766-bf43-c1929792695a => generated 1323 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:05:22.138528 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-e864b7a6-fffd-4d40-ba9f-eb8fb9cf504d tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:05:22.139180 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-e864b7a6-fffd-4d40-ba9f-eb8fb9cf504d tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] [instance: 254f065c-8cf6-4766-bf43-c1929792695a] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:05:22.141161 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG dbcounter [-] [129953] Writing DB stats nova_cell0:SELECT=2 {{(pid=129953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 11:05:22.141841 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG dbcounter [-] [129953] Writing DB stats nova_cell0:SELECT=6 {{(pid=129953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 11:05:22.147602 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-e864b7a6-fffd-4d40-ba9f-eb8fb9cf504d tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:05:22.148138 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-e864b7a6-fffd-4d40-ba9f-eb8fb9cf504d tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:05:22.148928 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-e864b7a6-fffd-4d40-ba9f-eb8fb9cf504d tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:05:22.149359 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-e864b7a6-fffd-4d40-ba9f-eb8fb9cf504d tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:05:22.298615 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-e864b7a6-fffd-4d40-ba9f-eb8fb9cf504d tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf80e69ea524d83ab199fc7315f4be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ebdffccaaa04484b32602a67fe23629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:05:22.306878 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-e864b7a6-fffd-4d40-ba9f-eb8fb9cf504d tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] 10.222.0.115 "GET /compute/v2.1/servers/254f065c-8cf6-4766-bf43-c1929792695a" status: 200 len: 1323 microversion: 2.1 time: 0.173025 Aug 02 11:05:22.307467 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 535/1061] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:05:22 2022] GET /compute/v2.1/servers/254f065c-8cf6-4766-bf43-c1929792695a => generated 1323 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:05:22.767731 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [req-79fd777f-0b10-46f4-9227-a11482e61dd9 req-a56573ad-6ced-438d-a8d2-396758793d16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "254f065c-8cf6-4766-bf43-c1929792695a", "name": "network-vif-plugged", "status": "completed", "tag": "93ea59a4-4874-4f7c-a534-57202be12e2b"}]} {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 11:05:22.773657 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG dbcounter [-] [129952] Writing DB stats nova_cell0:SELECT=2 {{(pid=129952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 11:05:22.779790 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [req-79fd777f-0b10-46f4-9227-a11482e61dd9 req-a56573ad-6ced-438d-a8d2-396758793d16 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:05:22.780376 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [req-79fd777f-0b10-46f4-9227-a11482e61dd9 req-a56573ad-6ced-438d-a8d2-396758793d16 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:05:22.791212 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.compute.server_external_events [req-79fd777f-0b10-46f4-9227-a11482e61dd9 req-a56573ad-6ced-438d-a8d2-396758793d16 service nova] Creating event network-vif-plugged:93ea59a4-4874-4f7c-a534-57202be12e2b for instance 254f065c-8cf6-4766-bf43-c1929792695a on hv-cinder-85031 Aug 02 11:05:22.797913 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [req-79fd777f-0b10-46f4-9227-a11482e61dd9 req-a56573ad-6ced-438d-a8d2-396758793d16 service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033005 Aug 02 11:05:22.797913 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 527/1062] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Aug 2 11:05:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 11:05:23.327648 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-89d50a34-79f5-4eff-9dfa-a75185889ef0 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:05:23.328248 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-89d50a34-79f5-4eff-9dfa-a75185889ef0 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] [instance: 254f065c-8cf6-4766-bf43-c1929792695a] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:05:23.334770 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-89d50a34-79f5-4eff-9dfa-a75185889ef0 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:05:23.336441 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-89d50a34-79f5-4eff-9dfa-a75185889ef0 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:05:23.337220 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-89d50a34-79f5-4eff-9dfa-a75185889ef0 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:05:23.337655 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-89d50a34-79f5-4eff-9dfa-a75185889ef0 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:05:23.471718 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-89d50a34-79f5-4eff-9dfa-a75185889ef0 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf80e69ea524d83ab199fc7315f4be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ebdffccaaa04484b32602a67fe23629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:05:23.479396 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-89d50a34-79f5-4eff-9dfa-a75185889ef0 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] 10.222.0.115 "GET /compute/v2.1/servers/254f065c-8cf6-4766-bf43-c1929792695a" status: 200 len: 1323 microversion: 2.1 time: 0.155596 Aug 02 11:05:23.479969 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 536/1063] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:05:23 2022] GET /compute/v2.1/servers/254f065c-8cf6-4766-bf43-c1929792695a => generated 1323 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:05:24.469605 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [req-5168e1f0-d2bb-4965-9f4d-1bfbc01ed081 req-16a66dd1-15c7-4155-a9a3-d854fa4650a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bca2caf3-fc41-4e08-b3ac-476df1fac08b", "tag": "3c75c1d1-beb4-4085-beda-a9f460b8bf87"}]} {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 11:05:24.477828 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-89f5da5f-bfa7-4bfc-8405-0dba2a184e3f tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:05:24.478671 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-89f5da5f-bfa7-4bfc-8405-0dba2a184e3f tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] [instance: bca2caf3-fc41-4e08-b3ac-476df1fac08b] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:05:24.481151 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [req-5168e1f0-d2bb-4965-9f4d-1bfbc01ed081 req-16a66dd1-15c7-4155-a9a3-d854fa4650a8 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:05:24.481852 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [req-5168e1f0-d2bb-4965-9f4d-1bfbc01ed081 req-16a66dd1-15c7-4155-a9a3-d854fa4650a8 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:05:24.486145 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-89f5da5f-bfa7-4bfc-8405-0dba2a184e3f tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:05:24.486600 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-89f5da5f-bfa7-4bfc-8405-0dba2a184e3f tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:05:24.487559 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-89f5da5f-bfa7-4bfc-8405-0dba2a184e3f tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:05:24.487999 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-89f5da5f-bfa7-4bfc-8405-0dba2a184e3f tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:05:24.494590 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.compute.server_external_events [req-5168e1f0-d2bb-4965-9f4d-1bfbc01ed081 req-16a66dd1-15c7-4155-a9a3-d854fa4650a8 service nova] Creating event network-changed:3c75c1d1-beb4-4085-beda-a9f460b8bf87 for instance bca2caf3-fc41-4e08-b3ac-476df1fac08b on hv-cinder-85031 Aug 02 11:05:24.500093 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [req-5168e1f0-d2bb-4965-9f4d-1bfbc01ed081 req-16a66dd1-15c7-4155-a9a3-d854fa4650a8 service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034146 Aug 02 11:05:24.500915 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 537/1064] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Aug 2 11:05:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 11:05:24.507132 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-ae05def8-e493-497c-ac61-1cc5353eb7d8 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:05:24.507934 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-ae05def8-e493-497c-ac61-1cc5353eb7d8 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] [instance: 254f065c-8cf6-4766-bf43-c1929792695a] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:05:24.514797 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-ae05def8-e493-497c-ac61-1cc5353eb7d8 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:05:24.515297 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-ae05def8-e493-497c-ac61-1cc5353eb7d8 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:05:24.516082 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-ae05def8-e493-497c-ac61-1cc5353eb7d8 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:05:24.516521 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-ae05def8-e493-497c-ac61-1cc5353eb7d8 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:05:24.520274 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-89f5da5f-bfa7-4bfc-8405-0dba2a184e3f tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] [instance: bca2caf3-fc41-4e08-b3ac-476df1fac08b] Going to try to terminate instance {{(pid=129952) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 11:05:24.705178 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-ae05def8-e493-497c-ac61-1cc5353eb7d8 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf80e69ea524d83ab199fc7315f4be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ebdffccaaa04484b32602a67fe23629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:05:24.727074 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-ae05def8-e493-497c-ac61-1cc5353eb7d8 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] 10.222.0.115 "GET /compute/v2.1/servers/254f065c-8cf6-4766-bf43-c1929792695a" status: 200 len: 1323 microversion: 2.1 time: 0.223809 Aug 02 11:05:24.728397 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 538/1065] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:05:24 2022] GET /compute/v2.1/servers/254f065c-8cf6-4766-bf43-c1929792695a => generated 1323 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:05:24.813525 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-89f5da5f-bfa7-4bfc-8405-0dba2a184e3f tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] 10.222.0.115 "DELETE /compute/v2.1/servers/bca2caf3-fc41-4e08-b3ac-476df1fac08b" status: 204 len: 0 microversion: 2.1 time: 0.340427 Aug 02 11:05:24.814459 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 528/1066] 10.222.0.115 () {58 vars in 1244 bytes} [Tue Aug 2 11:05:24 2022] DELETE /compute/v2.1/servers/bca2caf3-fc41-4e08-b3ac-476df1fac08b => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 11:05:24.822905 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-2c8255d4-a967-4f0a-9fc2-283ad1a0b345 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:05:24.823478 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-2c8255d4-a967-4f0a-9fc2-283ad1a0b345 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] [instance: bca2caf3-fc41-4e08-b3ac-476df1fac08b] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:05:24.830538 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-2c8255d4-a967-4f0a-9fc2-283ad1a0b345 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:05:24.831396 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-2c8255d4-a967-4f0a-9fc2-283ad1a0b345 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:05:24.832322 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-2c8255d4-a967-4f0a-9fc2-283ad1a0b345 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:05:24.832772 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-2c8255d4-a967-4f0a-9fc2-283ad1a0b345 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:05:24.972397 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-2c8255d4-a967-4f0a-9fc2-283ad1a0b345 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914de37664914b4cb91e0ce2c3a0e1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66234794284419a47e3afcae968084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:05:24.980323 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-2c8255d4-a967-4f0a-9fc2-283ad1a0b345 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] 10.222.0.115 "GET /compute/v2.1/servers/bca2caf3-fc41-4e08-b3ac-476df1fac08b" status: 200 len: 1581 microversion: 2.1 time: 0.161434 Aug 02 11:05:24.980926 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 539/1067] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:05:24 2022] GET /compute/v2.1/servers/bca2caf3-fc41-4e08-b3ac-476df1fac08b => generated 1581 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:05:25.748925 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-cedc2e36-ddd8-48b7-b90e-7a2a91f78568 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:05:25.750916 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-cedc2e36-ddd8-48b7-b90e-7a2a91f78568 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] [instance: 254f065c-8cf6-4766-bf43-c1929792695a] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:05:25.756671 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-cedc2e36-ddd8-48b7-b90e-7a2a91f78568 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:05:25.761431 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-cedc2e36-ddd8-48b7-b90e-7a2a91f78568 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:05:25.761431 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-cedc2e36-ddd8-48b7-b90e-7a2a91f78568 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:05:25.761431 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-cedc2e36-ddd8-48b7-b90e-7a2a91f78568 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:05:25.892300 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-cedc2e36-ddd8-48b7-b90e-7a2a91f78568 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf80e69ea524d83ab199fc7315f4be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ebdffccaaa04484b32602a67fe23629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:05:25.900923 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-cedc2e36-ddd8-48b7-b90e-7a2a91f78568 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] 10.222.0.115 "GET /compute/v2.1/servers/254f065c-8cf6-4766-bf43-c1929792695a" status: 200 len: 1513 microversion: 2.1 time: 0.156236 Aug 02 11:05:25.901783 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 529/1068] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:05:25 2022] GET /compute/v2.1/servers/254f065c-8cf6-4766-bf43-c1929792695a => generated 1513 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:05:25.931821 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-4618af88-7953-4429-bd0a-7064fb6e1045 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a260171a-1964-4040-9a5f-2a0e215c00ad", "device": "/dev/sdb"}} {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 11:05:25.934447 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-4618af88-7953-4429-bd0a-7064fb6e1045 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] [instance: 254f065c-8cf6-4766-bf43-c1929792695a] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:05:25.941743 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-4618af88-7953-4429-bd0a-7064fb6e1045 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:05:25.942274 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-4618af88-7953-4429-bd0a-7064fb6e1045 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:05:25.943211 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-4618af88-7953-4429-bd0a-7064fb6e1045 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:05:25.943709 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-4618af88-7953-4429-bd0a-7064fb6e1045 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:05:26.002361 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-cb88670c-34d8-48e8-b01b-0e3e3a432f77 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:05:26.002927 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-cb88670c-34d8-48e8-b01b-0e3e3a432f77 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] [instance: bca2caf3-fc41-4e08-b3ac-476df1fac08b] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:05:26.010740 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-cb88670c-34d8-48e8-b01b-0e3e3a432f77 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:05:26.011404 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-cb88670c-34d8-48e8-b01b-0e3e3a432f77 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:05:26.012044 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-cb88670c-34d8-48e8-b01b-0e3e3a432f77 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:05:26.013404 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-cb88670c-34d8-48e8-b01b-0e3e3a432f77 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:05:26.163427 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-cb88670c-34d8-48e8-b01b-0e3e3a432f77 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914de37664914b4cb91e0ce2c3a0e1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66234794284419a47e3afcae968084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:05:26.175342 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-cb88670c-34d8-48e8-b01b-0e3e3a432f77 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] 10.222.0.115 "GET /compute/v2.1/servers/bca2caf3-fc41-4e08-b3ac-476df1fac08b" status: 200 len: 1581 microversion: 2.1 time: 0.176992 Aug 02 11:05:26.176183 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 530/1069] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:05:25 2022] GET /compute/v2.1/servers/bca2caf3-fc41-4e08-b3ac-476df1fac08b => generated 1581 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 11:05:26.794914 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [req-c896e27e-a5f6-481d-933e-a737c228c0d3 req-4e90a245-c22e-4e04-8ce3-0eeb56fc0677 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bca2caf3-fc41-4e08-b3ac-476df1fac08b", "name": "network-vif-deleted", "tag": "3c75c1d1-beb4-4085-beda-a9f460b8bf87"}]} {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 11:05:26.806260 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [req-c896e27e-a5f6-481d-933e-a737c228c0d3 req-4e90a245-c22e-4e04-8ce3-0eeb56fc0677 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:05:26.806703 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [req-c896e27e-a5f6-481d-933e-a737c228c0d3 req-4e90a245-c22e-4e04-8ce3-0eeb56fc0677 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:05:26.828067 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.compute.server_external_events [req-c896e27e-a5f6-481d-933e-a737c228c0d3 req-4e90a245-c22e-4e04-8ce3-0eeb56fc0677 service nova] Creating event network-vif-deleted:3c75c1d1-beb4-4085-beda-a9f460b8bf87 for instance bca2caf3-fc41-4e08-b3ac-476df1fac08b on hv-cinder-85031 Aug 02 11:05:26.833408 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [req-c896e27e-a5f6-481d-933e-a737c228c0d3 req-4e90a245-c22e-4e04-8ce3-0eeb56fc0677 service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042231 Aug 02 11:05:26.835786 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 531/1070] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Aug 2 11:05:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 11:05:26.881197 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-4618af88-7953-4429-bd0a-7064fb6e1045 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] 10.222.0.115 "POST /compute/v2.1/servers/254f065c-8cf6-4766-bf43-c1929792695a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.953737 Aug 02 11:05:26.881864 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 540/1071] 10.222.0.115 () {60 vars in 1328 bytes} [Tue Aug 2 11:05:25 2022] POST /compute/v2.1/servers/254f065c-8cf6-4766-bf43-c1929792695a/os-volume_attachments => generated 194 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 11:05:27.199531 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-a7c41b6a-9322-4573-8199-c2c5222f3114 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:05:27.200258 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-a7c41b6a-9322-4573-8199-c2c5222f3114 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] [instance: bca2caf3-fc41-4e08-b3ac-476df1fac08b] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:05:27.207600 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-a7c41b6a-9322-4573-8199-c2c5222f3114 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:05:27.208071 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-a7c41b6a-9322-4573-8199-c2c5222f3114 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:05:27.209094 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-a7c41b6a-9322-4573-8199-c2c5222f3114 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:05:27.209781 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-a7c41b6a-9322-4573-8199-c2c5222f3114 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:05:27.279825 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-a7c41b6a-9322-4573-8199-c2c5222f3114 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914de37664914b4cb91e0ce2c3a0e1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66234794284419a47e3afcae968084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:05:27.287715 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-a7c41b6a-9322-4573-8199-c2c5222f3114 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] 10.222.0.115 "GET /compute/v2.1/servers/bca2caf3-fc41-4e08-b3ac-476df1fac08b" status: 200 len: 1229 microversion: 2.1 time: 0.093318 Aug 02 11:05:27.288804 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 532/1072] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:05:27 2022] GET /compute/v2.1/servers/bca2caf3-fc41-4e08-b3ac-476df1fac08b => generated 1229 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:05:28.313518 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-750a17ae-3788-49ab-bcff-3f04c71c1cee tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:05:28.314740 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-750a17ae-3788-49ab-bcff-3f04c71c1cee tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] [instance: bca2caf3-fc41-4e08-b3ac-476df1fac08b] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:05:28.322820 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-750a17ae-3788-49ab-bcff-3f04c71c1cee tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:05:28.323317 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-750a17ae-3788-49ab-bcff-3f04c71c1cee tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:05:28.324093 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-750a17ae-3788-49ab-bcff-3f04c71c1cee tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:05:28.324555 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-750a17ae-3788-49ab-bcff-3f04c71c1cee tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:05:28.329646 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG dbcounter [-] [129953] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 11:05:28.339401 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.wsgi [None req-750a17ae-3788-49ab-bcff-3f04c71c1cee tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] HTTP exception thrown: Instance bca2caf3-fc41-4e08-b3ac-476df1fac08b could not be found. Aug 02 11:05:28.341057 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-750a17ae-3788-49ab-bcff-3f04c71c1cee tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Request method failure captured: Aug 02 11:05:28.341057 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: request: GET /compute/v2.1/servers/bca2caf3-fc41-4e08-b3ac-476df1fac08b HTTP/1.1 Aug 02 11:05:28.341057 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Accept: application/json Aug 02 11:05:28.341057 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Accept-Encoding: identity Aug 02 11:05:28.341057 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Connection: close Aug 02 11:05:28.341057 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Content-Length: 0 Aug 02 11:05:28.341057 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Content-Type: application/json Aug 02 11:05:28.341057 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Host: 10.222.0.115 Aug 02 11:05:28.341057 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Openstack-System-Scope: None Aug 02 11:05:28.341057 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: User-Agent: python-urllib3/1.26.10 Aug 02 11:05:28.341057 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Auth-Token: gAAAAABi6QLq99om1OPWk1UijdLFE4rJ9tpb2cZBQAHRTgACTzCFftT30PxRbh5RhDYBxLkgEX_E-dzDxhNIcBXD70mTnMHeO4WPGCOlL9LKe34lSDb6brF9YXse81gOOuIm6GWNmPlYen1_XTIBq7GyPb3kwWB2BtnBJaDfo20Av8axtorTXVA Aug 02 11:05:28.341057 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Domain-Id: None Aug 02 11:05:28.341057 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Domain-Name: None Aug 02 11:05:28.341057 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Identity-Status: Confirmed Aug 02 11:05:28.341057 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Is-Admin-Project: True Aug 02 11:05:28.341057 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Project-Domain-Id: default Aug 02 11:05:28.341057 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Project-Domain-Name: Default Aug 02 11:05:28.341057 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Project-Id: be66234794284419a47e3afcae968084 Aug 02 11:05:28.341057 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Project-Name: tempest-TestVolumeBootPattern-1859072211 Aug 02 11:05:28.341057 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Role: reader,member Aug 02 11:05:28.341057 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Roles: reader,member Aug 02 11:05:28.346125 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/be66234794284419a47e3afcae968084"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2/be66234794284419a47e3afcae968084"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/be66234794284419a47e3afcae968084"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.115:8080", "publicURL": "http://10.222.0.115:8080/v1/AUTH_be66234794284419a47e3afcae968084"}]}] Aug 02 11:05:28.346125 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Tenant: tempest-TestVolumeBootPattern-1859072211 Aug 02 11:05:28.346125 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Tenant-Id: be66234794284419a47e3afcae968084 Aug 02 11:05:28.346125 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Tenant-Name: tempest-TestVolumeBootPattern-1859072211 Aug 02 11:05:28.346125 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User: tempest-TestVolumeBootPattern-1859072211-project Aug 02 11:05:28.346125 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User-Domain-Id: default Aug 02 11:05:28.346125 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User-Domain-Name: Default Aug 02 11:05:28.346125 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User-Id: 914de37664914b4cb91e0ce2c3a0e1d1 Aug 02 11:05:28.346125 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User-Name: tempest-TestVolumeBootPattern-1859072211-project Aug 02 11:05:28.346125 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: method: > Aug 02 11:05:28.346125 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: exception: Instance bca2caf3-fc41-4e08-b3ac-476df1fac08b could not be found. Aug 02 11:05:28.346125 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: action_args: {'id': 'bca2caf3-fc41-4e08-b3ac-476df1fac08b'} Aug 02 11:05:28.349787 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 11:05:28.349787 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:05:28.349787 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 11:05:28.349787 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 11:05:28.349787 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 11:05:28.349787 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 11:05:28.349787 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 11:05:28.349787 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 11:05:28.349787 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 11:05:28.349787 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 11:05:28.349787 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bca2caf3-fc41-4e08-b3ac-476df1fac08b could not be found. Aug 02 11:05:28.349787 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 11:05:28.349787 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 11:05:28.349787 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 11:05:28.349787 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:05:28.349787 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 11:05:28.349787 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 11:05:28.349787 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 11:05:28.349787 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 11:05:28.349787 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 11:05:28.353455 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 11:05:28.353455 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 11:05:28.353455 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 11:05:28.353455 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 11:05:28.353455 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 11:05:28.353455 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 11:05:28.353455 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 11:05:28.353455 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bca2caf3-fc41-4e08-b3ac-476df1fac08b could not be found. Aug 02 11:05:28.353455 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 11:05:28.353455 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 11:05:28.353455 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 11:05:28.353455 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:05:28.353455 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 11:05:28.353455 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 11:05:28.353455 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 11:05:28.353455 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 11:05:28.353455 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bca2caf3-fc41-4e08-b3ac-476df1fac08b could not be found. Aug 02 11:05:28.353455 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 11:05:28.355688 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-750a17ae-3788-49ab-bcff-3f04c71c1cee tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Returning 404 to user: Instance bca2caf3-fc41-4e08-b3ac-476df1fac08b could not be found. {{(pid=129953) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 11:05:28.355688 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-750a17ae-3788-49ab-bcff-3f04c71c1cee tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] 10.222.0.115 "GET /compute/v2.1/servers/bca2caf3-fc41-4e08-b3ac-476df1fac08b" status: 404 len: 111 microversion: 2.1 time: 0.036476 Aug 02 11:05:28.355688 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 541/1073] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:05:28 2022] GET /compute/v2.1/servers/bca2caf3-fc41-4e08-b3ac-476df1fac08b => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 11:05:28.910293 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-c553b6fa-94c7-4685-bf60-f7ef89a2f1c8 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:05:28.910868 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-c553b6fa-94c7-4685-bf60-f7ef89a2f1c8 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] [instance: eb175839-504d-4d07-b576-d51202b9ccae] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:05:28.918514 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-c553b6fa-94c7-4685-bf60-f7ef89a2f1c8 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:05:28.918967 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-c553b6fa-94c7-4685-bf60-f7ef89a2f1c8 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:05:28.919789 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-c553b6fa-94c7-4685-bf60-f7ef89a2f1c8 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:05:28.920234 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-c553b6fa-94c7-4685-bf60-f7ef89a2f1c8 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:05:28.934671 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.wsgi [None req-c553b6fa-94c7-4685-bf60-f7ef89a2f1c8 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] HTTP exception thrown: Instance eb175839-504d-4d07-b576-d51202b9ccae could not be found. Aug 02 11:05:28.936414 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-c553b6fa-94c7-4685-bf60-f7ef89a2f1c8 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Request method failure captured: Aug 02 11:05:28.936414 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: request: DELETE /compute/v2.1/servers/eb175839-504d-4d07-b576-d51202b9ccae HTTP/1.1 Aug 02 11:05:28.936414 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Accept: application/json Aug 02 11:05:28.936414 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Accept-Encoding: identity Aug 02 11:05:28.936414 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Connection: close Aug 02 11:05:28.936414 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Content-Length: 0 Aug 02 11:05:28.936414 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Content-Type: application/json Aug 02 11:05:28.936414 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Host: 10.222.0.115 Aug 02 11:05:28.936414 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Openstack-System-Scope: None Aug 02 11:05:28.936414 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: User-Agent: python-urllib3/1.26.10 Aug 02 11:05:28.936414 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Auth-Token: gAAAAABi6QLq99om1OPWk1UijdLFE4rJ9tpb2cZBQAHRTgACTzCFftT30PxRbh5RhDYBxLkgEX_E-dzDxhNIcBXD70mTnMHeO4WPGCOlL9LKe34lSDb6brF9YXse81gOOuIm6GWNmPlYen1_XTIBq7GyPb3kwWB2BtnBJaDfo20Av8axtorTXVA Aug 02 11:05:28.936414 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Domain-Id: None Aug 02 11:05:28.936414 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Domain-Name: None Aug 02 11:05:28.936414 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Identity-Status: Confirmed Aug 02 11:05:28.936414 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Is-Admin-Project: True Aug 02 11:05:28.936414 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Project-Domain-Id: default Aug 02 11:05:28.936414 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Project-Domain-Name: Default Aug 02 11:05:28.936414 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Project-Id: be66234794284419a47e3afcae968084 Aug 02 11:05:28.936414 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Project-Name: tempest-TestVolumeBootPattern-1859072211 Aug 02 11:05:28.936414 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Role: reader,member Aug 02 11:05:28.936414 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Roles: reader,member Aug 02 11:05:28.939186 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/be66234794284419a47e3afcae968084"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2/be66234794284419a47e3afcae968084"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/be66234794284419a47e3afcae968084"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.115:8080", "publicURL": "http://10.222.0.115:8080/v1/AUTH_be66234794284419a47e3afcae968084"}]}] Aug 02 11:05:28.939186 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Tenant: tempest-TestVolumeBootPattern-1859072211 Aug 02 11:05:28.939186 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Tenant-Id: be66234794284419a47e3afcae968084 Aug 02 11:05:28.939186 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Tenant-Name: tempest-TestVolumeBootPattern-1859072211 Aug 02 11:05:28.939186 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User: tempest-TestVolumeBootPattern-1859072211-project Aug 02 11:05:28.939186 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User-Domain-Id: default Aug 02 11:05:28.939186 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User-Domain-Name: Default Aug 02 11:05:28.939186 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User-Id: 914de37664914b4cb91e0ce2c3a0e1d1 Aug 02 11:05:28.939186 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User-Name: tempest-TestVolumeBootPattern-1859072211-project Aug 02 11:05:28.939186 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: method: > Aug 02 11:05:28.939186 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: exception: Instance eb175839-504d-4d07-b576-d51202b9ccae could not be found. Aug 02 11:05:28.939186 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: action_args: {'id': 'eb175839-504d-4d07-b576-d51202b9ccae'} Aug 02 11:05:28.940993 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 11:05:28.940993 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:05:28.940993 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 11:05:28.940993 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 11:05:28.940993 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 11:05:28.940993 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 11:05:28.940993 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 11:05:28.940993 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 11:05:28.940993 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 11:05:28.940993 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 11:05:28.940993 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb175839-504d-4d07-b576-d51202b9ccae could not be found. Aug 02 11:05:28.940993 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 11:05:28.940993 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 11:05:28.940993 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 11:05:28.940993 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:05:28.940993 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 11:05:28.940993 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 11:05:28.940993 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 11:05:28.940993 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 11:05:28.940993 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 11:05:28.943774 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 11:05:28.943774 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 11:05:28.943774 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 11:05:28.943774 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 11:05:28.943774 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 11:05:28.943774 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 11:05:28.943774 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 11:05:28.943774 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 11:05:28.943774 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 11:05:28.943774 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb175839-504d-4d07-b576-d51202b9ccae could not be found. Aug 02 11:05:28.943774 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 11:05:28.943774 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 11:05:28.943774 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 11:05:28.943774 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:05:28.943774 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 11:05:28.943774 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 11:05:28.943774 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 11:05:28.943774 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 11:05:28.943774 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb175839-504d-4d07-b576-d51202b9ccae could not be found. Aug 02 11:05:28.943774 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 11:05:28.946013 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-c553b6fa-94c7-4685-bf60-f7ef89a2f1c8 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Returning 404 to user: Instance eb175839-504d-4d07-b576-d51202b9ccae could not be found. {{(pid=129952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 11:05:28.946013 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-c553b6fa-94c7-4685-bf60-f7ef89a2f1c8 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] 10.222.0.115 "DELETE /compute/v2.1/servers/eb175839-504d-4d07-b576-d51202b9ccae" status: 404 len: 111 microversion: 2.1 time: 0.034636 Aug 02 11:05:28.946013 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 533/1074] 10.222.0.115 () {58 vars in 1244 bytes} [Tue Aug 2 11:05:28 2022] DELETE /compute/v2.1/servers/eb175839-504d-4d07-b576-d51202b9ccae => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 11:05:28.952648 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-f7eb9cae-b2bb-4516-94bd-9f265d0df80f tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:05:28.953255 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-f7eb9cae-b2bb-4516-94bd-9f265d0df80f tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] [instance: eb175839-504d-4d07-b576-d51202b9ccae] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:05:28.960242 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-f7eb9cae-b2bb-4516-94bd-9f265d0df80f tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:05:28.960926 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-f7eb9cae-b2bb-4516-94bd-9f265d0df80f tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:05:28.961946 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-f7eb9cae-b2bb-4516-94bd-9f265d0df80f tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:05:28.962377 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-f7eb9cae-b2bb-4516-94bd-9f265d0df80f tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:05:28.977552 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.wsgi [None req-f7eb9cae-b2bb-4516-94bd-9f265d0df80f tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] HTTP exception thrown: Instance eb175839-504d-4d07-b576-d51202b9ccae could not be found. Aug 02 11:05:28.979112 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-f7eb9cae-b2bb-4516-94bd-9f265d0df80f tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Request method failure captured: Aug 02 11:05:28.979112 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: request: GET /compute/v2.1/servers/eb175839-504d-4d07-b576-d51202b9ccae HTTP/1.1 Aug 02 11:05:28.979112 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Accept: application/json Aug 02 11:05:28.979112 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Accept-Encoding: identity Aug 02 11:05:28.979112 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Connection: close Aug 02 11:05:28.979112 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Content-Length: 0 Aug 02 11:05:28.979112 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Content-Type: application/json Aug 02 11:05:28.979112 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Host: 10.222.0.115 Aug 02 11:05:28.979112 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Openstack-System-Scope: None Aug 02 11:05:28.979112 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: User-Agent: python-urllib3/1.26.10 Aug 02 11:05:28.979112 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Auth-Token: gAAAAABi6QLq99om1OPWk1UijdLFE4rJ9tpb2cZBQAHRTgACTzCFftT30PxRbh5RhDYBxLkgEX_E-dzDxhNIcBXD70mTnMHeO4WPGCOlL9LKe34lSDb6brF9YXse81gOOuIm6GWNmPlYen1_XTIBq7GyPb3kwWB2BtnBJaDfo20Av8axtorTXVA Aug 02 11:05:28.979112 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Domain-Id: None Aug 02 11:05:28.979112 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Domain-Name: None Aug 02 11:05:28.979112 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Identity-Status: Confirmed Aug 02 11:05:28.979112 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Is-Admin-Project: True Aug 02 11:05:28.979112 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Project-Domain-Id: default Aug 02 11:05:28.979112 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Project-Domain-Name: Default Aug 02 11:05:28.979112 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Project-Id: be66234794284419a47e3afcae968084 Aug 02 11:05:28.979112 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Project-Name: tempest-TestVolumeBootPattern-1859072211 Aug 02 11:05:28.979112 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Role: reader,member Aug 02 11:05:28.979112 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Roles: reader,member Aug 02 11:05:28.981124 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/be66234794284419a47e3afcae968084"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2/be66234794284419a47e3afcae968084"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/be66234794284419a47e3afcae968084"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.115:8080", "publicURL": "http://10.222.0.115:8080/v1/AUTH_be66234794284419a47e3afcae968084"}]}] Aug 02 11:05:28.981124 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Tenant: tempest-TestVolumeBootPattern-1859072211 Aug 02 11:05:28.981124 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Tenant-Id: be66234794284419a47e3afcae968084 Aug 02 11:05:28.981124 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Tenant-Name: tempest-TestVolumeBootPattern-1859072211 Aug 02 11:05:28.981124 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User: tempest-TestVolumeBootPattern-1859072211-project Aug 02 11:05:28.981124 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User-Domain-Id: default Aug 02 11:05:28.981124 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User-Domain-Name: Default Aug 02 11:05:28.981124 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User-Id: 914de37664914b4cb91e0ce2c3a0e1d1 Aug 02 11:05:28.981124 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User-Name: tempest-TestVolumeBootPattern-1859072211-project Aug 02 11:05:28.981124 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: method: > Aug 02 11:05:28.981124 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: exception: Instance eb175839-504d-4d07-b576-d51202b9ccae could not be found. Aug 02 11:05:28.981124 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: action_args: {'id': 'eb175839-504d-4d07-b576-d51202b9ccae'} Aug 02 11:05:28.982083 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 11:05:28.982083 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:05:28.982083 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 11:05:28.982083 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 11:05:28.982083 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 11:05:28.982083 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 11:05:28.982083 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 11:05:28.982083 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 11:05:28.982083 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 11:05:28.982083 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 11:05:28.982083 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb175839-504d-4d07-b576-d51202b9ccae could not be found. Aug 02 11:05:28.982083 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 11:05:28.982083 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 11:05:28.982083 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 11:05:28.982083 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:05:28.982083 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 11:05:28.982083 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 11:05:28.982083 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 11:05:28.982083 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 11:05:28.982083 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 11:05:28.983624 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 11:05:28.983624 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 11:05:28.983624 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 11:05:28.983624 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 11:05:28.983624 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 11:05:28.983624 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 11:05:28.983624 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 11:05:28.983624 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb175839-504d-4d07-b576-d51202b9ccae could not be found. Aug 02 11:05:28.983624 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 11:05:28.983624 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 11:05:28.983624 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 11:05:28.983624 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:05:28.983624 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 11:05:28.983624 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 11:05:28.983624 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 11:05:28.983624 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 11:05:28.983624 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb175839-504d-4d07-b576-d51202b9ccae could not be found. Aug 02 11:05:28.983624 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 11:05:28.984915 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-f7eb9cae-b2bb-4516-94bd-9f265d0df80f tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Returning 404 to user: Instance eb175839-504d-4d07-b576-d51202b9ccae could not be found. {{(pid=129953) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 11:05:28.984915 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-f7eb9cae-b2bb-4516-94bd-9f265d0df80f tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] 10.222.0.115 "GET /compute/v2.1/servers/eb175839-504d-4d07-b576-d51202b9ccae" status: 404 len: 111 microversion: 2.1 time: 0.033217 Aug 02 11:05:28.984915 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 542/1075] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:05:28 2022] GET /compute/v2.1/servers/eb175839-504d-4d07-b576-d51202b9ccae => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 02 11:05:30.545987 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-694af11f-5dbe-42c6-8a76-0854022d9c85 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] Calling method '.version_select at 0x7f7c4ed63b80>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:05:30.661171 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-694af11f-5dbe-42c6-8a76-0854022d9c85 tempest-TestVolumeBootPattern-1859072211 tempest-TestVolumeBootPattern-1859072211-project] 10.222.0.115 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1578588330" status: 202 len: 0 microversion: 2.1 time: 0.119597 Aug 02 11:05:30.661791 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 534/1076] 10.222.0.115 () {58 vars in 1268 bytes} [Tue Aug 2 11:05:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1578588330 => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 11:05:47.125933 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-8f80ac6a-7e78-4b0c-9493-a7b1e88f145a tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:05:47.126507 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-8f80ac6a-7e78-4b0c-9493-a7b1e88f145a tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] [instance: 254f065c-8cf6-4766-bf43-c1929792695a] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:05:47.128977 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG dbcounter [-] [129953] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=129953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 11:05:47.135093 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-8f80ac6a-7e78-4b0c-9493-a7b1e88f145a tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:05:47.135550 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-8f80ac6a-7e78-4b0c-9493-a7b1e88f145a tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:05:47.136353 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-8f80ac6a-7e78-4b0c-9493-a7b1e88f145a tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:05:47.136795 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-8f80ac6a-7e78-4b0c-9493-a7b1e88f145a tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:05:47.219979 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.objects.instance [None req-8f80ac6a-7e78-4b0c-9493-a7b1e88f145a tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lazy-loading 'services' on Instance uuid 254f065c-8cf6-4766-bf43-c1929792695a {{(pid=129953) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 11:05:47.469161 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-8f80ac6a-7e78-4b0c-9493-a7b1e88f145a tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] 10.222.0.115 "DELETE /compute/v2.1/servers/254f065c-8cf6-4766-bf43-c1929792695a/os-volume_attachments/a260171a-1964-4040-9a5f-2a0e215c00ad" status: 202 len: 0 microversion: 2.1 time: 0.347401 Aug 02 11:05:47.474398 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 543/1077] 10.222.0.115 () {58 vars in 1421 bytes} [Tue Aug 2 11:05:47 2022] DELETE /compute/v2.1/servers/254f065c-8cf6-4766-bf43-c1929792695a/os-volume_attachments/a260171a-1964-4040-9a5f-2a0e215c00ad => generated 0 bytes in 349 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 11:05:48.584874 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-7fa1b389-3510-43bf-80b8-d8860d59872d tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:05:48.585415 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-7fa1b389-3510-43bf-80b8-d8860d59872d tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] [instance: 254f065c-8cf6-4766-bf43-c1929792695a] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:05:48.587739 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG dbcounter [-] [129952] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 11:05:48.588520 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG dbcounter [-] [129952] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 11:05:48.594074 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-7fa1b389-3510-43bf-80b8-d8860d59872d tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:05:48.597360 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-7fa1b389-3510-43bf-80b8-d8860d59872d tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:05:48.597360 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-7fa1b389-3510-43bf-80b8-d8860d59872d tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:05:48.597360 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-7fa1b389-3510-43bf-80b8-d8860d59872d tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:05:48.623789 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-7fa1b389-3510-43bf-80b8-d8860d59872d tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] [instance: 254f065c-8cf6-4766-bf43-c1929792695a] Going to try to terminate instance {{(pid=129952) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 11:05:48.893544 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-7fa1b389-3510-43bf-80b8-d8860d59872d tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] 10.222.0.115 "DELETE /compute/v2.1/servers/254f065c-8cf6-4766-bf43-c1929792695a" status: 204 len: 0 microversion: 2.1 time: 0.312139 Aug 02 11:05:48.894415 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 535/1078] 10.222.0.115 () {58 vars in 1244 bytes} [Tue Aug 2 11:05:48 2022] DELETE /compute/v2.1/servers/254f065c-8cf6-4766-bf43-c1929792695a => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 11:05:48.903744 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-0079431e-b0cd-485d-b885-3b0da5508365 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:05:48.904422 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-0079431e-b0cd-485d-b885-3b0da5508365 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] [instance: 254f065c-8cf6-4766-bf43-c1929792695a] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:05:48.910626 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-0079431e-b0cd-485d-b885-3b0da5508365 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:05:48.911111 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-0079431e-b0cd-485d-b885-3b0da5508365 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:05:48.911871 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-0079431e-b0cd-485d-b885-3b0da5508365 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:05:48.912305 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-0079431e-b0cd-485d-b885-3b0da5508365 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:05:49.048942 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-0079431e-b0cd-485d-b885-3b0da5508365 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf80e69ea524d83ab199fc7315f4be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ebdffccaaa04484b32602a67fe23629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:05:49.057193 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-0079431e-b0cd-485d-b885-3b0da5508365 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] 10.222.0.115 "GET /compute/v2.1/servers/254f065c-8cf6-4766-bf43-c1929792695a" status: 200 len: 1519 microversion: 2.1 time: 0.158226 Aug 02 11:05:49.057762 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 544/1079] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:05:48 2022] GET /compute/v2.1/servers/254f065c-8cf6-4766-bf43-c1929792695a => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:05:50.079389 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-269906f3-75e1-4590-955b-8d1774f43ee5 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:05:50.080107 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-269906f3-75e1-4590-955b-8d1774f43ee5 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] [instance: 254f065c-8cf6-4766-bf43-c1929792695a] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:05:50.086572 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-269906f3-75e1-4590-955b-8d1774f43ee5 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:05:50.088249 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-269906f3-75e1-4590-955b-8d1774f43ee5 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:05:50.088646 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-269906f3-75e1-4590-955b-8d1774f43ee5 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:05:50.089078 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-269906f3-75e1-4590-955b-8d1774f43ee5 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:05:50.227210 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-269906f3-75e1-4590-955b-8d1774f43ee5 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf80e69ea524d83ab199fc7315f4be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ebdffccaaa04484b32602a67fe23629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:05:50.235727 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-269906f3-75e1-4590-955b-8d1774f43ee5 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] 10.222.0.115 "GET /compute/v2.1/servers/254f065c-8cf6-4766-bf43-c1929792695a" status: 200 len: 1519 microversion: 2.1 time: 0.160639 Aug 02 11:05:50.236305 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 536/1080] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:05:50 2022] GET /compute/v2.1/servers/254f065c-8cf6-4766-bf43-c1929792695a => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:05:51.257256 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-ddc84b1f-09a0-42db-8e57-627d98b56bfe tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:05:51.257891 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-ddc84b1f-09a0-42db-8e57-627d98b56bfe tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] [instance: 254f065c-8cf6-4766-bf43-c1929792695a] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:05:51.265217 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-ddc84b1f-09a0-42db-8e57-627d98b56bfe tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:05:51.265699 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-ddc84b1f-09a0-42db-8e57-627d98b56bfe tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:05:51.266745 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-ddc84b1f-09a0-42db-8e57-627d98b56bfe tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:05:51.267427 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-ddc84b1f-09a0-42db-8e57-627d98b56bfe tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:05:51.279737 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [req-dcff2bb7-de0c-4034-9ea4-a618c4e85b7b req-2c76b4d7-9028-4301-876c-806c1cf6c654 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "254f065c-8cf6-4766-bf43-c1929792695a", "name": "network-vif-deleted", "tag": "93ea59a4-4874-4f7c-a534-57202be12e2b"}]} {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 11:05:51.289617 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [req-dcff2bb7-de0c-4034-9ea4-a618c4e85b7b req-2c76b4d7-9028-4301-876c-806c1cf6c654 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:05:51.290157 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [req-dcff2bb7-de0c-4034-9ea4-a618c4e85b7b req-2c76b4d7-9028-4301-876c-806c1cf6c654 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:05:51.302398 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.compute.server_external_events [req-dcff2bb7-de0c-4034-9ea4-a618c4e85b7b req-2c76b4d7-9028-4301-876c-806c1cf6c654 service nova] Creating event network-vif-deleted:93ea59a4-4874-4f7c-a534-57202be12e2b for instance 254f065c-8cf6-4766-bf43-c1929792695a on hv-cinder-85031 Aug 02 11:05:51.307763 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [req-dcff2bb7-de0c-4034-9ea4-a618c4e85b7b req-2c76b4d7-9028-4301-876c-806c1cf6c654 service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.207507 Aug 02 11:05:51.308518 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 545/1081] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Aug 2 11:05:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 11:05:51.340253 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-ddc84b1f-09a0-42db-8e57-627d98b56bfe tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf80e69ea524d83ab199fc7315f4be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ebdffccaaa04484b32602a67fe23629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:05:51.347818 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-ddc84b1f-09a0-42db-8e57-627d98b56bfe tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] 10.222.0.115 "GET /compute/v2.1/servers/254f065c-8cf6-4766-bf43-c1929792695a" status: 200 len: 1308 microversion: 2.1 time: 0.094654 Aug 02 11:05:51.348423 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 537/1082] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:05:51 2022] GET /compute/v2.1/servers/254f065c-8cf6-4766-bf43-c1929792695a => generated 1308 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 11:05:52.369572 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-d5eb9f54-6c69-4a1f-bfbd-774f7408a100 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:05:52.370266 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-d5eb9f54-6c69-4a1f-bfbd-774f7408a100 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] [instance: 254f065c-8cf6-4766-bf43-c1929792695a] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:05:52.377009 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-d5eb9f54-6c69-4a1f-bfbd-774f7408a100 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:05:52.377455 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-d5eb9f54-6c69-4a1f-bfbd-774f7408a100 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:05:52.378211 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-d5eb9f54-6c69-4a1f-bfbd-774f7408a100 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:05:52.378643 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-d5eb9f54-6c69-4a1f-bfbd-774f7408a100 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:05:52.392295 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.wsgi [None req-d5eb9f54-6c69-4a1f-bfbd-774f7408a100 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] HTTP exception thrown: Instance 254f065c-8cf6-4766-bf43-c1929792695a could not be found. Aug 02 11:05:52.393903 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-d5eb9f54-6c69-4a1f-bfbd-774f7408a100 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Request method failure captured: Aug 02 11:05:52.393903 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: request: GET /compute/v2.1/servers/254f065c-8cf6-4766-bf43-c1929792695a HTTP/1.1 Aug 02 11:05:52.393903 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Accept: application/json Aug 02 11:05:52.393903 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Accept-Encoding: identity Aug 02 11:05:52.393903 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Connection: close Aug 02 11:05:52.393903 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Content-Length: 0 Aug 02 11:05:52.393903 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Content-Type: application/json Aug 02 11:05:52.393903 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Host: 10.222.0.115 Aug 02 11:05:52.393903 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Openstack-System-Scope: None Aug 02 11:05:52.393903 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: User-Agent: python-urllib3/1.26.10 Aug 02 11:05:52.393903 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Auth-Token: gAAAAABi6QR4TYR5crXOZxj8FZbgjIaCX0kw6N2ktLpyNbf4U-HetefyQvb3T71yWDWrdyTMQUGPb_KY8Yz-6ZYCtqUHRIF-Ud02kIj1F37qpVFrL4Sr7UEFs41rQt1y0iWCmFqlSpVJHnfsWkGoncRfDpnNxqrv4hDmLvklb6KB2V_85BFu8Uw Aug 02 11:05:52.393903 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Domain-Id: None Aug 02 11:05:52.393903 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Domain-Name: None Aug 02 11:05:52.393903 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Identity-Status: Confirmed Aug 02 11:05:52.393903 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Is-Admin-Project: True Aug 02 11:05:52.393903 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Project-Domain-Id: default Aug 02 11:05:52.393903 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Project-Domain-Name: Default Aug 02 11:05:52.393903 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Project-Id: 1ebdffccaaa04484b32602a67fe23629 Aug 02 11:05:52.393903 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Project-Name: tempest-VolumesSnapshotTestJSON-463230268 Aug 02 11:05:52.393903 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Role: reader,member Aug 02 11:05:52.393903 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Roles: reader,member Aug 02 11:05:52.395671 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/1ebdffccaaa04484b32602a67fe23629"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2/1ebdffccaaa04484b32602a67fe23629"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/1ebdffccaaa04484b32602a67fe23629"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.115:8080", "publicURL": "http://10.222.0.115:8080/v1/AUTH_1ebdffccaaa04484b32602a67fe23629"}]}] Aug 02 11:05:52.395671 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Tenant: tempest-VolumesSnapshotTestJSON-463230268 Aug 02 11:05:52.395671 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Tenant-Id: 1ebdffccaaa04484b32602a67fe23629 Aug 02 11:05:52.395671 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-463230268 Aug 02 11:05:52.395671 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User: tempest-VolumesSnapshotTestJSON-463230268-project Aug 02 11:05:52.395671 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User-Domain-Id: default Aug 02 11:05:52.395671 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User-Domain-Name: Default Aug 02 11:05:52.395671 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User-Id: 6bf80e69ea524d83ab199fc7315f4be2 Aug 02 11:05:52.395671 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User-Name: tempest-VolumesSnapshotTestJSON-463230268-project Aug 02 11:05:52.395671 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: method: > Aug 02 11:05:52.395671 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: exception: Instance 254f065c-8cf6-4766-bf43-c1929792695a could not be found. Aug 02 11:05:52.395671 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: action_args: {'id': '254f065c-8cf6-4766-bf43-c1929792695a'} Aug 02 11:05:52.396800 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 11:05:52.396800 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:05:52.396800 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 11:05:52.396800 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 11:05:52.396800 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 11:05:52.396800 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 11:05:52.396800 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 11:05:52.396800 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 11:05:52.396800 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 11:05:52.396800 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 11:05:52.396800 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 254f065c-8cf6-4766-bf43-c1929792695a could not be found. Aug 02 11:05:52.396800 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 11:05:52.396800 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 11:05:52.396800 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 11:05:52.396800 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:05:52.396800 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 11:05:52.396800 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 11:05:52.396800 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 11:05:52.396800 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 11:05:52.396800 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 11:05:52.398437 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 11:05:52.398437 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 11:05:52.398437 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 11:05:52.398437 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 11:05:52.398437 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 11:05:52.398437 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 11:05:52.398437 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 11:05:52.398437 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 254f065c-8cf6-4766-bf43-c1929792695a could not be found. Aug 02 11:05:52.398437 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 11:05:52.398437 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 11:05:52.398437 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 11:05:52.398437 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:05:52.398437 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 11:05:52.398437 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 11:05:52.398437 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 11:05:52.398437 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 11:05:52.398437 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 254f065c-8cf6-4766-bf43-c1929792695a could not be found. Aug 02 11:05:52.398437 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 11:05:52.405823 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-d5eb9f54-6c69-4a1f-bfbd-774f7408a100 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] Returning 404 to user: Instance 254f065c-8cf6-4766-bf43-c1929792695a could not be found. {{(pid=129953) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 11:05:52.405823 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-d5eb9f54-6c69-4a1f-bfbd-774f7408a100 tempest-VolumesSnapshotTestJSON-463230268 tempest-VolumesSnapshotTestJSON-463230268-project] 10.222.0.115 "GET /compute/v2.1/servers/254f065c-8cf6-4766-bf43-c1929792695a" status: 404 len: 111 microversion: 2.1 time: 0.030033 Aug 02 11:05:52.405823 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 546/1083] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:05:52 2022] GET /compute/v2.1/servers/254f065c-8cf6-4766-bf43-c1929792695a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 11:06:42.335311 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-ece227c3-bd1d-4933-bb00-57ac8de8516a tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Action: 'create', calling method: .version_select at 0x7f7c4ee5a940>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-15166502", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDkHVj61Vwdrt5PKN7uVV5ChGLgDbSQgOwxi2bXwHt9ZUlR/mQX0WUEj2Z6zakjNEkymGCic/NmzKRLSB0MvlDHd6ovNb70ZYzG6Enx+3OiIWeRhrqN3nDM0xa7gv9JicA=="}} {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 11:06:42.342308 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG dbcounter [-] [129952] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=129952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 11:06:42.342996 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG dbcounter [-] [129952] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 11:06:42.356958 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.quota [None req-ece227c3-bd1d-4933-bb00-57ac8de8516a tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Getting quotas for project bb052a6c83084dd9bdbf408ad8870c16. Resources: {'key_pairs'} {{(pid=129952) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 11:06:42.361153 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.quota [None req-ece227c3-bd1d-4933-bb00-57ac8de8516a tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Getting quotas for user 7509ddedcec74149bb850e4adf64b489 and project bb052a6c83084dd9bdbf408ad8870c16. Resources: {'key_pairs'} {{(pid=129952) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 11:06:42.429728 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-ece227c3-bd1d-4933-bb00-57ac8de8516a tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] 10.222.0.115 "POST /compute/v2.1/os-keypairs" status: 200 len: 401 microversion: 2.1 time: 0.098420 Aug 02 11:06:42.430256 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 538/1084] 10.222.0.115 () {60 vars in 1164 bytes} [Tue Aug 2 11:06:42 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 11:06:42.495205 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-6caef7c6-d17c-4ec1-bc4b-04fb92e56424 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-873456427", "imageRef": "6641170b-9aec-4f99-8423-48214ac18f42", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-15166502", "networks": [{"uuid": "a6082f63-3141-4ca8-974e-b8906c948f97"}]}} {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 11:06:42.504264 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG dbcounter [-] [129953] Writing DB stats nova_api:SELECT=8 {{(pid=129953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 11:06:42.504929 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG dbcounter [-] [129953] Writing DB stats nova_cell1:SELECT=21,nova_cell1:INSERT=1 {{(pid=129953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 11:06:42.550130 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.network.neutron [None req-6caef7c6-d17c-4ec1-bc4b-04fb92e56424 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] validate_networks() for [('a6082f63-3141-4ca8-974e-b8906c948f97', None, None, None, None, None)] {{(pid=129953) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 11:06:42.937431 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.virt.hardware [None req-6caef7c6-d17c-4ec1-bc4b-04fb92e56424 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Flavor limits 0:0:0 {{(pid=129953) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 11:06:42.937856 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.virt.hardware [None req-6caef7c6-d17c-4ec1-bc4b-04fb92e56424 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Image limits 0:0:0 {{(pid=129953) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 11:06:42.938329 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.virt.hardware [None req-6caef7c6-d17c-4ec1-bc4b-04fb92e56424 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Flavor pref 0:0:0 {{(pid=129953) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 11:06:42.938737 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.virt.hardware [None req-6caef7c6-d17c-4ec1-bc4b-04fb92e56424 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Image pref 0:0:0 {{(pid=129953) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 11:06:42.939190 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.virt.hardware [None req-6caef7c6-d17c-4ec1-bc4b-04fb92e56424 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129953) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 11:06:42.948079 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-6caef7c6-d17c-4ec1-bc4b-04fb92e56424 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:06:42.948675 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-6caef7c6-d17c-4ec1-bc4b-04fb92e56424 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:06:42.949479 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-6caef7c6-d17c-4ec1-bc4b-04fb92e56424 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:06:42.949916 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-6caef7c6-d17c-4ec1-bc4b-04fb92e56424 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:06:42.966461 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.quota [None req-6caef7c6-d17c-4ec1-bc4b-04fb92e56424 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Getting quotas for project bb052a6c83084dd9bdbf408ad8870c16. Resources: {'instances', 'cores', 'ram'} {{(pid=129953) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 11:06:42.970330 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.quota [None req-6caef7c6-d17c-4ec1-bc4b-04fb92e56424 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Getting quotas for user 7509ddedcec74149bb850e4adf64b489 and project bb052a6c83084dd9bdbf408ad8870c16. Resources: {'instances', 'cores', 'ram'} {{(pid=129953) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 11:06:42.981885 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-6caef7c6-d17c-4ec1-bc4b-04fb92e56424 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Going to run 1 instances... {{(pid=129953) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 11:06:42.984096 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-6caef7c6-d17c-4ec1-bc4b-04fb92e56424 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] [instance: 08091fd4-fdee-47e2-8f4c-772622ff2837] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6641170b-9aec-4f99-8423-48214ac18f42',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129953) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 11:06:43.097800 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-6caef7c6-d17c-4ec1-bc4b-04fb92e56424 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] 10.222.0.115 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.606657 Aug 02 11:06:43.098444 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 547/1085] 10.222.0.115 () {60 vars in 1152 bytes} [Tue Aug 2 11:06:42 2022] POST /compute/v2.1/servers => generated 382 bytes in 608 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Aug 02 11:06:43.110116 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-b49c7ebc-516f-470b-a77a-b085e746e875 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:06:43.110725 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-b49c7ebc-516f-470b-a77a-b085e746e875 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] [instance: 08091fd4-fdee-47e2-8f4c-772622ff2837] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:06:43.165375 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-b49c7ebc-516f-470b-a77a-b085e746e875 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7509ddedcec74149bb850e4adf64b489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb052a6c83084dd9bdbf408ad8870c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:06:43.172925 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-b49c7ebc-516f-470b-a77a-b085e746e875 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] 10.222.0.115 "GET /compute/v2.1/servers/08091fd4-fdee-47e2-8f4c-772622ff2837" status: 200 len: 1260 microversion: 2.1 time: 0.067225 Aug 02 11:06:43.173500 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 539/1086] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:06:43 2022] GET /compute/v2.1/servers/08091fd4-fdee-47e2-8f4c-772622ff2837 => generated 1260 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:06:44.194964 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-e0643ca4-1728-49a8-b5b6-3a74d926f3d0 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:06:44.195610 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-e0643ca4-1728-49a8-b5b6-3a74d926f3d0 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] [instance: 08091fd4-fdee-47e2-8f4c-772622ff2837] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:06:44.254557 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-e0643ca4-1728-49a8-b5b6-3a74d926f3d0 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7509ddedcec74149bb850e4adf64b489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb052a6c83084dd9bdbf408ad8870c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:06:44.261637 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-e0643ca4-1728-49a8-b5b6-3a74d926f3d0 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] 10.222.0.115 "GET /compute/v2.1/servers/08091fd4-fdee-47e2-8f4c-772622ff2837" status: 200 len: 1260 microversion: 2.1 time: 0.071358 Aug 02 11:06:44.262218 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 548/1087] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:06:44 2022] GET /compute/v2.1/servers/08091fd4-fdee-47e2-8f4c-772622ff2837 => generated 1260 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 11:06:45.286005 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-0f949f17-9d2f-4d80-9ef0-d260cfd0531b tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:06:45.286622 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-0f949f17-9d2f-4d80-9ef0-d260cfd0531b tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] [instance: 08091fd4-fdee-47e2-8f4c-772622ff2837] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:06:45.344459 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-0f949f17-9d2f-4d80-9ef0-d260cfd0531b tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7509ddedcec74149bb850e4adf64b489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb052a6c83084dd9bdbf408ad8870c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:06:45.351293 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-0f949f17-9d2f-4d80-9ef0-d260cfd0531b tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] 10.222.0.115 "GET /compute/v2.1/servers/08091fd4-fdee-47e2-8f4c-772622ff2837" status: 200 len: 1260 microversion: 2.1 time: 0.069198 Aug 02 11:06:45.351859 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 540/1088] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:06:45 2022] GET /compute/v2.1/servers/08091fd4-fdee-47e2-8f4c-772622ff2837 => generated 1260 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:06:46.372428 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-8b45c964-6dd4-4e72-94fb-7cb615cc74a7 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:06:46.373034 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-8b45c964-6dd4-4e72-94fb-7cb615cc74a7 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] [instance: 08091fd4-fdee-47e2-8f4c-772622ff2837] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:06:46.427800 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-8b45c964-6dd4-4e72-94fb-7cb615cc74a7 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7509ddedcec74149bb850e4adf64b489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb052a6c83084dd9bdbf408ad8870c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:06:46.434833 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-8b45c964-6dd4-4e72-94fb-7cb615cc74a7 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] 10.222.0.115 "GET /compute/v2.1/servers/08091fd4-fdee-47e2-8f4c-772622ff2837" status: 200 len: 1260 microversion: 2.1 time: 0.066590 Aug 02 11:06:46.436471 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 549/1089] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:06:46 2022] GET /compute/v2.1/servers/08091fd4-fdee-47e2-8f4c-772622ff2837 => generated 1260 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:06:47.465664 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-c73e5cc7-bfa8-45ab-ad2c-acd914ad6790 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:06:47.466311 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-c73e5cc7-bfa8-45ab-ad2c-acd914ad6790 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] [instance: 08091fd4-fdee-47e2-8f4c-772622ff2837] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:06:47.473154 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-c73e5cc7-bfa8-45ab-ad2c-acd914ad6790 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:06:47.473599 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-c73e5cc7-bfa8-45ab-ad2c-acd914ad6790 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:06:47.474369 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-c73e5cc7-bfa8-45ab-ad2c-acd914ad6790 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:06:47.474801 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-c73e5cc7-bfa8-45ab-ad2c-acd914ad6790 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:06:47.537300 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-c73e5cc7-bfa8-45ab-ad2c-acd914ad6790 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7509ddedcec74149bb850e4adf64b489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb052a6c83084dd9bdbf408ad8870c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:06:47.545624 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-c73e5cc7-bfa8-45ab-ad2c-acd914ad6790 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] 10.222.0.115 "GET /compute/v2.1/servers/08091fd4-fdee-47e2-8f4c-772622ff2837" status: 200 len: 1264 microversion: 2.1 time: 0.083941 Aug 02 11:06:47.546197 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 541/1090] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:06:47 2022] GET /compute/v2.1/servers/08091fd4-fdee-47e2-8f4c-772622ff2837 => generated 1264 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:06:48.567441 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-6181f18d-3508-4aca-b440-7d7d9f0d886d tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:06:48.568141 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-6181f18d-3508-4aca-b440-7d7d9f0d886d tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] [instance: 08091fd4-fdee-47e2-8f4c-772622ff2837] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:06:48.575521 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-6181f18d-3508-4aca-b440-7d7d9f0d886d tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:06:48.575971 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-6181f18d-3508-4aca-b440-7d7d9f0d886d tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:06:48.576757 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-6181f18d-3508-4aca-b440-7d7d9f0d886d tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:06:48.577194 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-6181f18d-3508-4aca-b440-7d7d9f0d886d tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:06:48.644684 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-6181f18d-3508-4aca-b440-7d7d9f0d886d tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7509ddedcec74149bb850e4adf64b489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb052a6c83084dd9bdbf408ad8870c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:06:48.652558 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-6181f18d-3508-4aca-b440-7d7d9f0d886d tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] 10.222.0.115 "GET /compute/v2.1/servers/08091fd4-fdee-47e2-8f4c-772622ff2837" status: 200 len: 1264 microversion: 2.1 time: 0.088988 Aug 02 11:06:48.653134 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 550/1091] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:06:48 2022] GET /compute/v2.1/servers/08091fd4-fdee-47e2-8f4c-772622ff2837 => generated 1264 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:06:49.673845 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-40028a62-1f10-437e-b948-768f5d26288e tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:06:49.674492 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-40028a62-1f10-437e-b948-768f5d26288e tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] [instance: 08091fd4-fdee-47e2-8f4c-772622ff2837] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:06:49.681428 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-40028a62-1f10-437e-b948-768f5d26288e tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:06:49.681877 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-40028a62-1f10-437e-b948-768f5d26288e tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:06:49.682648 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-40028a62-1f10-437e-b948-768f5d26288e tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:06:49.683091 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-40028a62-1f10-437e-b948-768f5d26288e tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:06:49.756460 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-40028a62-1f10-437e-b948-768f5d26288e tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7509ddedcec74149bb850e4adf64b489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb052a6c83084dd9bdbf408ad8870c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:06:49.765343 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-40028a62-1f10-437e-b948-768f5d26288e tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] 10.222.0.115 "GET /compute/v2.1/servers/08091fd4-fdee-47e2-8f4c-772622ff2837" status: 200 len: 1330 microversion: 2.1 time: 0.095624 Aug 02 11:06:49.765936 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 542/1092] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:06:49 2022] GET /compute/v2.1/servers/08091fd4-fdee-47e2-8f4c-772622ff2837 => generated 1330 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:06:50.788000 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-b53cd8aa-6267-4cba-9285-adc1de307700 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:06:50.789248 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-b53cd8aa-6267-4cba-9285-adc1de307700 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] [instance: 08091fd4-fdee-47e2-8f4c-772622ff2837] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:06:50.796641 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-b53cd8aa-6267-4cba-9285-adc1de307700 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:06:50.797507 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-b53cd8aa-6267-4cba-9285-adc1de307700 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:06:50.798567 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-b53cd8aa-6267-4cba-9285-adc1de307700 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:06:50.799265 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-b53cd8aa-6267-4cba-9285-adc1de307700 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:06:51.121527 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-b53cd8aa-6267-4cba-9285-adc1de307700 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7509ddedcec74149bb850e4adf64b489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb052a6c83084dd9bdbf408ad8870c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:06:51.130390 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-b53cd8aa-6267-4cba-9285-adc1de307700 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] 10.222.0.115 "GET /compute/v2.1/servers/08091fd4-fdee-47e2-8f4c-772622ff2837" status: 200 len: 1360 microversion: 2.1 time: 0.346435 Aug 02 11:06:51.131722 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 551/1093] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:06:50 2022] GET /compute/v2.1/servers/08091fd4-fdee-47e2-8f4c-772622ff2837 => generated 1360 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:06:51.610786 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [req-a5373e2b-eb13-45e0-a727-7d8b12ff0d7e req-e92077fc-aa73-4c71-8710-6e66d65d5f63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08091fd4-fdee-47e2-8f4c-772622ff2837", "tag": "eab89b32-bc20-4112-a7c7-fa0ff15d11d9"}]} {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 11:06:51.626362 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [req-a5373e2b-eb13-45e0-a727-7d8b12ff0d7e req-e92077fc-aa73-4c71-8710-6e66d65d5f63 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:06:51.627034 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [req-a5373e2b-eb13-45e0-a727-7d8b12ff0d7e req-e92077fc-aa73-4c71-8710-6e66d65d5f63 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:06:51.645945 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.compute.server_external_events [req-a5373e2b-eb13-45e0-a727-7d8b12ff0d7e req-e92077fc-aa73-4c71-8710-6e66d65d5f63 service nova] Creating event network-changed:eab89b32-bc20-4112-a7c7-fa0ff15d11d9 for instance 08091fd4-fdee-47e2-8f4c-772622ff2837 on hv-cinder-85031 Aug 02 11:06:51.652801 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [req-a5373e2b-eb13-45e0-a727-7d8b12ff0d7e req-e92077fc-aa73-4c71-8710-6e66d65d5f63 service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045927 Aug 02 11:06:51.654730 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 543/1094] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Aug 2 11:06:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 11:06:52.160562 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-057484ca-0bc2-4192-83fa-9f8e186426d5 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:06:52.161178 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-057484ca-0bc2-4192-83fa-9f8e186426d5 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] [instance: 08091fd4-fdee-47e2-8f4c-772622ff2837] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:06:52.168102 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-057484ca-0bc2-4192-83fa-9f8e186426d5 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:06:52.168554 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-057484ca-0bc2-4192-83fa-9f8e186426d5 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:06:52.169339 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-057484ca-0bc2-4192-83fa-9f8e186426d5 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:06:52.169782 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-057484ca-0bc2-4192-83fa-9f8e186426d5 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:06:52.329949 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-057484ca-0bc2-4192-83fa-9f8e186426d5 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7509ddedcec74149bb850e4adf64b489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb052a6c83084dd9bdbf408ad8870c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:06:52.340225 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-057484ca-0bc2-4192-83fa-9f8e186426d5 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] 10.222.0.115 "GET /compute/v2.1/servers/08091fd4-fdee-47e2-8f4c-772622ff2837" status: 200 len: 1360 microversion: 2.1 time: 0.183555 Aug 02 11:06:52.340807 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 552/1095] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:06:52 2022] GET /compute/v2.1/servers/08091fd4-fdee-47e2-8f4c-772622ff2837 => generated 1360 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:06:53.364022 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-625de98e-957f-4c90-803f-64b6fc6b295b tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:06:53.365247 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-625de98e-957f-4c90-803f-64b6fc6b295b tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] [instance: 08091fd4-fdee-47e2-8f4c-772622ff2837] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:06:53.371580 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-625de98e-957f-4c90-803f-64b6fc6b295b tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:06:53.372038 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-625de98e-957f-4c90-803f-64b6fc6b295b tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:06:53.372813 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-625de98e-957f-4c90-803f-64b6fc6b295b tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:06:53.373250 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-625de98e-957f-4c90-803f-64b6fc6b295b tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:06:53.540462 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-625de98e-957f-4c90-803f-64b6fc6b295b tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7509ddedcec74149bb850e4adf64b489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb052a6c83084dd9bdbf408ad8870c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:06:53.548040 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-625de98e-957f-4c90-803f-64b6fc6b295b tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] 10.222.0.115 "GET /compute/v2.1/servers/08091fd4-fdee-47e2-8f4c-772622ff2837" status: 200 len: 1360 microversion: 2.1 time: 0.189088 Aug 02 11:06:53.548841 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 544/1096] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:06:53 2022] GET /compute/v2.1/servers/08091fd4-fdee-47e2-8f4c-772622ff2837 => generated 1360 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:06:54.570075 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-738346af-4ce9-44d3-823c-b59bd38aa238 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:06:54.570719 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-738346af-4ce9-44d3-823c-b59bd38aa238 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] [instance: 08091fd4-fdee-47e2-8f4c-772622ff2837] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:06:54.572919 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG dbcounter [-] [129953] Writing DB stats nova_cell0:SELECT=2 {{(pid=129953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 11:06:54.579172 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-738346af-4ce9-44d3-823c-b59bd38aa238 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:06:54.579615 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-738346af-4ce9-44d3-823c-b59bd38aa238 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:06:54.580380 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-738346af-4ce9-44d3-823c-b59bd38aa238 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:06:54.580815 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-738346af-4ce9-44d3-823c-b59bd38aa238 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:06:54.717946 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-738346af-4ce9-44d3-823c-b59bd38aa238 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7509ddedcec74149bb850e4adf64b489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb052a6c83084dd9bdbf408ad8870c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:06:54.725668 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-738346af-4ce9-44d3-823c-b59bd38aa238 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] 10.222.0.115 "GET /compute/v2.1/servers/08091fd4-fdee-47e2-8f4c-772622ff2837" status: 200 len: 1360 microversion: 2.1 time: 0.159746 Aug 02 11:06:54.726427 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 553/1097] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:06:54 2022] GET /compute/v2.1/servers/08091fd4-fdee-47e2-8f4c-772622ff2837 => generated 1360 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:06:55.746756 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-6a27f65e-e650-46e4-b709-79b9a61c795d tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:06:55.748405 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-6a27f65e-e650-46e4-b709-79b9a61c795d tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] [instance: 08091fd4-fdee-47e2-8f4c-772622ff2837] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:06:55.751473 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG dbcounter [-] [129952] Writing DB stats nova_cell0:SELECT=8 {{(pid=129952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 11:06:55.756875 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-6a27f65e-e650-46e4-b709-79b9a61c795d tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:06:55.757400 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-6a27f65e-e650-46e4-b709-79b9a61c795d tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:06:55.758447 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-6a27f65e-e650-46e4-b709-79b9a61c795d tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:06:55.758941 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-6a27f65e-e650-46e4-b709-79b9a61c795d tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:06:55.901236 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-6a27f65e-e650-46e4-b709-79b9a61c795d tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7509ddedcec74149bb850e4adf64b489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb052a6c83084dd9bdbf408ad8870c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:06:55.908938 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-6a27f65e-e650-46e4-b709-79b9a61c795d tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] 10.222.0.115 "GET /compute/v2.1/servers/08091fd4-fdee-47e2-8f4c-772622ff2837" status: 200 len: 1360 microversion: 2.1 time: 0.166322 Aug 02 11:06:55.909514 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 545/1098] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:06:55 2022] GET /compute/v2.1/servers/08091fd4-fdee-47e2-8f4c-772622ff2837 => generated 1360 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:06:56.929855 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-5d5763e3-e33d-41ca-92a9-9f6687208cfe tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:06:56.930629 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-5d5763e3-e33d-41ca-92a9-9f6687208cfe tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] [instance: 08091fd4-fdee-47e2-8f4c-772622ff2837] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:06:56.932870 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG dbcounter [-] [129953] Writing DB stats nova_cell0:SELECT=10 {{(pid=129953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 11:06:56.939424 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-5d5763e3-e33d-41ca-92a9-9f6687208cfe tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:06:56.939877 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-5d5763e3-e33d-41ca-92a9-9f6687208cfe tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:06:56.940664 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-5d5763e3-e33d-41ca-92a9-9f6687208cfe tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:06:56.941106 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-5d5763e3-e33d-41ca-92a9-9f6687208cfe tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:06:57.089027 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-5d5763e3-e33d-41ca-92a9-9f6687208cfe tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7509ddedcec74149bb850e4adf64b489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb052a6c83084dd9bdbf408ad8870c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:06:57.096821 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-5d5763e3-e33d-41ca-92a9-9f6687208cfe tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] 10.222.0.115 "GET /compute/v2.1/servers/08091fd4-fdee-47e2-8f4c-772622ff2837" status: 200 len: 1360 microversion: 2.1 time: 0.170843 Aug 02 11:06:57.097403 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 554/1099] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:06:56 2022] GET /compute/v2.1/servers/08091fd4-fdee-47e2-8f4c-772622ff2837 => generated 1360 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:06:58.117947 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-847d5163-d9b5-4e35-bfdc-95258e5fc420 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:06:58.118581 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-847d5163-d9b5-4e35-bfdc-95258e5fc420 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] [instance: 08091fd4-fdee-47e2-8f4c-772622ff2837] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:06:58.125981 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-847d5163-d9b5-4e35-bfdc-95258e5fc420 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:06:58.126425 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-847d5163-d9b5-4e35-bfdc-95258e5fc420 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:06:58.127224 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-847d5163-d9b5-4e35-bfdc-95258e5fc420 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:06:58.127655 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-847d5163-d9b5-4e35-bfdc-95258e5fc420 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:06:58.267753 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-847d5163-d9b5-4e35-bfdc-95258e5fc420 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7509ddedcec74149bb850e4adf64b489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb052a6c83084dd9bdbf408ad8870c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:06:58.275498 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-847d5163-d9b5-4e35-bfdc-95258e5fc420 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] 10.222.0.115 "GET /compute/v2.1/servers/08091fd4-fdee-47e2-8f4c-772622ff2837" status: 200 len: 1360 microversion: 2.1 time: 0.161330 Aug 02 11:06:58.277799 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 546/1100] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:06:58 2022] GET /compute/v2.1/servers/08091fd4-fdee-47e2-8f4c-772622ff2837 => generated 1360 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:06:59.296378 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-95d35fa2-86fa-4127-b2a9-8bf3e7ad22cf tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:06:59.296992 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-95d35fa2-86fa-4127-b2a9-8bf3e7ad22cf tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] [instance: 08091fd4-fdee-47e2-8f4c-772622ff2837] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:06:59.303404 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-95d35fa2-86fa-4127-b2a9-8bf3e7ad22cf tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:06:59.303847 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-95d35fa2-86fa-4127-b2a9-8bf3e7ad22cf tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:06:59.304599 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-95d35fa2-86fa-4127-b2a9-8bf3e7ad22cf tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:06:59.305028 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-95d35fa2-86fa-4127-b2a9-8bf3e7ad22cf tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:06:59.478297 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-95d35fa2-86fa-4127-b2a9-8bf3e7ad22cf tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7509ddedcec74149bb850e4adf64b489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb052a6c83084dd9bdbf408ad8870c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:06:59.486309 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-95d35fa2-86fa-4127-b2a9-8bf3e7ad22cf tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] 10.222.0.115 "GET /compute/v2.1/servers/08091fd4-fdee-47e2-8f4c-772622ff2837" status: 200 len: 1360 microversion: 2.1 time: 0.194038 Aug 02 11:06:59.486883 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 555/1101] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:06:59 2022] GET /compute/v2.1/servers/08091fd4-fdee-47e2-8f4c-772622ff2837 => generated 1360 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:07:00.509193 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-4914346d-3e5e-4593-8b06-d611b8cf17fb tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:07:00.509893 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-4914346d-3e5e-4593-8b06-d611b8cf17fb tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] [instance: 08091fd4-fdee-47e2-8f4c-772622ff2837] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:07:00.518063 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-4914346d-3e5e-4593-8b06-d611b8cf17fb tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:07:00.518645 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-4914346d-3e5e-4593-8b06-d611b8cf17fb tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:07:00.519688 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-4914346d-3e5e-4593-8b06-d611b8cf17fb tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:07:00.520249 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-4914346d-3e5e-4593-8b06-d611b8cf17fb tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:07:00.730441 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-4914346d-3e5e-4593-8b06-d611b8cf17fb tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7509ddedcec74149bb850e4adf64b489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb052a6c83084dd9bdbf408ad8870c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:07:00.730441 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-4914346d-3e5e-4593-8b06-d611b8cf17fb tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] 10.222.0.115 "GET /compute/v2.1/servers/08091fd4-fdee-47e2-8f4c-772622ff2837" status: 200 len: 1360 microversion: 2.1 time: 0.169582 Aug 02 11:07:00.730441 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 547/1102] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:07:00 2022] GET /compute/v2.1/servers/08091fd4-fdee-47e2-8f4c-772622ff2837 => generated 1360 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:07:01.695154 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-ab5bcf6a-7c32-4401-9145-bf23e0f431ad tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:07:01.695767 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-ab5bcf6a-7c32-4401-9145-bf23e0f431ad tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] [instance: 08091fd4-fdee-47e2-8f4c-772622ff2837] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:07:01.702333 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-ab5bcf6a-7c32-4401-9145-bf23e0f431ad tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:07:01.702782 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-ab5bcf6a-7c32-4401-9145-bf23e0f431ad tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:07:01.703611 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-ab5bcf6a-7c32-4401-9145-bf23e0f431ad tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:07:01.704049 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-ab5bcf6a-7c32-4401-9145-bf23e0f431ad tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:07:01.840638 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-ab5bcf6a-7c32-4401-9145-bf23e0f431ad tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7509ddedcec74149bb850e4adf64b489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb052a6c83084dd9bdbf408ad8870c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:07:01.849450 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-ab5bcf6a-7c32-4401-9145-bf23e0f431ad tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] 10.222.0.115 "GET /compute/v2.1/servers/08091fd4-fdee-47e2-8f4c-772622ff2837" status: 200 len: 1360 microversion: 2.1 time: 0.158141 Aug 02 11:07:01.850045 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 556/1103] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:07:01 2022] GET /compute/v2.1/servers/08091fd4-fdee-47e2-8f4c-772622ff2837 => generated 1360 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 11:07:02.870885 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-8f226710-ba04-4b39-9cb1-1c4f4494a055 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:07:02.871552 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-8f226710-ba04-4b39-9cb1-1c4f4494a055 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] [instance: 08091fd4-fdee-47e2-8f4c-772622ff2837] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:07:02.878423 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-8f226710-ba04-4b39-9cb1-1c4f4494a055 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:07:02.878869 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-8f226710-ba04-4b39-9cb1-1c4f4494a055 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:07:02.879661 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-8f226710-ba04-4b39-9cb1-1c4f4494a055 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:07:02.880095 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-8f226710-ba04-4b39-9cb1-1c4f4494a055 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:07:03.014397 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-8f226710-ba04-4b39-9cb1-1c4f4494a055 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7509ddedcec74149bb850e4adf64b489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb052a6c83084dd9bdbf408ad8870c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:07:03.022637 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-8f226710-ba04-4b39-9cb1-1c4f4494a055 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] 10.222.0.115 "GET /compute/v2.1/servers/08091fd4-fdee-47e2-8f4c-772622ff2837" status: 200 len: 1360 microversion: 2.1 time: 0.155689 Aug 02 11:07:03.023229 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 548/1104] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:07:02 2022] GET /compute/v2.1/servers/08091fd4-fdee-47e2-8f4c-772622ff2837 => generated 1360 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:07:03.735573 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [req-0af1cbea-16bb-4e0d-bb22-295c06bcec3e req-cbac2f54-f47b-4a3c-864e-18afc394217c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08091fd4-fdee-47e2-8f4c-772622ff2837", "name": "network-vif-plugged", "status": "completed", "tag": "eab89b32-bc20-4112-a7c7-fa0ff15d11d9"}]} {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 11:07:03.745338 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [req-0af1cbea-16bb-4e0d-bb22-295c06bcec3e req-cbac2f54-f47b-4a3c-864e-18afc394217c service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:07:03.745781 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [req-0af1cbea-16bb-4e0d-bb22-295c06bcec3e req-cbac2f54-f47b-4a3c-864e-18afc394217c service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:07:03.757279 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.compute.server_external_events [req-0af1cbea-16bb-4e0d-bb22-295c06bcec3e req-cbac2f54-f47b-4a3c-864e-18afc394217c service nova] Creating event network-vif-plugged:eab89b32-bc20-4112-a7c7-fa0ff15d11d9 for instance 08091fd4-fdee-47e2-8f4c-772622ff2837 on hv-cinder-85031 Aug 02 11:07:03.762188 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [req-0af1cbea-16bb-4e0d-bb22-295c06bcec3e req-cbac2f54-f47b-4a3c-864e-18afc394217c service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151699 Aug 02 11:07:03.762765 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 557/1105] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Aug 2 11:07:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 11:07:04.046315 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-2307ebce-b32a-4298-9f20-c059471b6496 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:07:04.047714 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-2307ebce-b32a-4298-9f20-c059471b6496 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] [instance: 08091fd4-fdee-47e2-8f4c-772622ff2837] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:07:04.055368 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-2307ebce-b32a-4298-9f20-c059471b6496 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:07:04.055971 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-2307ebce-b32a-4298-9f20-c059471b6496 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:07:04.056910 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-2307ebce-b32a-4298-9f20-c059471b6496 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:07:04.057215 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-2307ebce-b32a-4298-9f20-c059471b6496 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:07:04.207173 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-2307ebce-b32a-4298-9f20-c059471b6496 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7509ddedcec74149bb850e4adf64b489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb052a6c83084dd9bdbf408ad8870c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:07:04.214665 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-2307ebce-b32a-4298-9f20-c059471b6496 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] 10.222.0.115 "GET /compute/v2.1/servers/08091fd4-fdee-47e2-8f4c-772622ff2837" status: 200 len: 1360 microversion: 2.1 time: 0.172308 Aug 02 11:07:04.215431 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 549/1106] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:07:04 2022] GET /compute/v2.1/servers/08091fd4-fdee-47e2-8f4c-772622ff2837 => generated 1360 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:07:05.236986 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-d7c3c5a4-7e9e-42cf-a5eb-eac04ed558e4 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:07:05.237681 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-d7c3c5a4-7e9e-42cf-a5eb-eac04ed558e4 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] [instance: 08091fd4-fdee-47e2-8f4c-772622ff2837] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:07:05.243964 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-d7c3c5a4-7e9e-42cf-a5eb-eac04ed558e4 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:07:05.244422 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-d7c3c5a4-7e9e-42cf-a5eb-eac04ed558e4 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:07:05.245177 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-d7c3c5a4-7e9e-42cf-a5eb-eac04ed558e4 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:07:05.245611 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-d7c3c5a4-7e9e-42cf-a5eb-eac04ed558e4 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:07:05.375215 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-d7c3c5a4-7e9e-42cf-a5eb-eac04ed558e4 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7509ddedcec74149bb850e4adf64b489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb052a6c83084dd9bdbf408ad8870c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:07:05.382541 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-d7c3c5a4-7e9e-42cf-a5eb-eac04ed558e4 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] 10.222.0.115 "GET /compute/v2.1/servers/08091fd4-fdee-47e2-8f4c-772622ff2837" status: 200 len: 1360 microversion: 2.1 time: 0.150516 Aug 02 11:07:05.383298 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 558/1107] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:07:05 2022] GET /compute/v2.1/servers/08091fd4-fdee-47e2-8f4c-772622ff2837 => generated 1360 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:07:06.404294 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-229cda67-ff85-487c-8955-902db655a1c5 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:07:06.404908 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-229cda67-ff85-487c-8955-902db655a1c5 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] [instance: 08091fd4-fdee-47e2-8f4c-772622ff2837] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:07:06.411566 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-229cda67-ff85-487c-8955-902db655a1c5 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:07:06.413758 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-229cda67-ff85-487c-8955-902db655a1c5 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:07:06.413758 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-229cda67-ff85-487c-8955-902db655a1c5 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:07:06.413758 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-229cda67-ff85-487c-8955-902db655a1c5 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:07:06.551994 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-229cda67-ff85-487c-8955-902db655a1c5 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7509ddedcec74149bb850e4adf64b489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb052a6c83084dd9bdbf408ad8870c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:07:06.559632 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-229cda67-ff85-487c-8955-902db655a1c5 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] 10.222.0.115 "GET /compute/v2.1/servers/08091fd4-fdee-47e2-8f4c-772622ff2837" status: 200 len: 1551 microversion: 2.1 time: 0.159340 Aug 02 11:07:06.560195 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 550/1108] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:07:06 2022] GET /compute/v2.1/servers/08091fd4-fdee-47e2-8f4c-772622ff2837 => generated 1551 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 11:07:06.581516 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-26dfb6bc-ca2d-4ec0-b1ae-4e7b84543216 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:07:06.582105 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-26dfb6bc-ca2d-4ec0-b1ae-4e7b84543216 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] [instance: 08091fd4-fdee-47e2-8f4c-772622ff2837] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:07:06.588793 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-26dfb6bc-ca2d-4ec0-b1ae-4e7b84543216 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:07:06.589248 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-26dfb6bc-ca2d-4ec0-b1ae-4e7b84543216 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:07:06.590012 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-26dfb6bc-ca2d-4ec0-b1ae-4e7b84543216 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:07:06.590445 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-26dfb6bc-ca2d-4ec0-b1ae-4e7b84543216 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:07:06.727187 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-26dfb6bc-ca2d-4ec0-b1ae-4e7b84543216 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7509ddedcec74149bb850e4adf64b489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb052a6c83084dd9bdbf408ad8870c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:07:06.735914 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-26dfb6bc-ca2d-4ec0-b1ae-4e7b84543216 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] 10.222.0.115 "GET /compute/v2.1/servers/08091fd4-fdee-47e2-8f4c-772622ff2837" status: 200 len: 1551 microversion: 2.1 time: 0.159128 Aug 02 11:07:06.736715 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 559/1109] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:07:06 2022] GET /compute/v2.1/servers/08091fd4-fdee-47e2-8f4c-772622ff2837 => generated 1551 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:07:06.756367 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-c3ff197f-5187-40fb-ba70-fcf77349eb2e tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:07:06.761339 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-c3ff197f-5187-40fb-ba70-fcf77349eb2e tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7509ddedcec74149bb850e4adf64b489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb052a6c83084dd9bdbf408ad8870c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:07:06.762096 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-c3ff197f-5187-40fb-ba70-fcf77349eb2e tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Searching by: {'deleted': False, 'project_id': 'bb052a6c83084dd9bdbf408ad8870c16'} {{(pid=129952) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 02 11:07:06.769220 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-c3ff197f-5187-40fb-ba70-fcf77349eb2e tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:07:06.769664 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-c3ff197f-5187-40fb-ba70-fcf77349eb2e tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:07:06.770450 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-c3ff197f-5187-40fb-ba70-fcf77349eb2e tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:07:06.770877 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-c3ff197f-5187-40fb-ba70-fcf77349eb2e tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:07:06.862708 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.multi_cell_list [None req-c3ff197f-5187-40fb-ba70-fcf77349eb2e tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=129952) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 02 11:07:06.960453 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-c3ff197f-5187-40fb-ba70-fcf77349eb2e tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] 10.222.0.115 "GET /compute/v2.1/servers" status: 200 len: 344 microversion: 2.1 time: 0.207731 Aug 02 11:07:06.960982 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 551/1110] 10.222.0.115 () {58 vars in 1130 bytes} [Tue Aug 2 11:07:06 2022] GET /compute/v2.1/servers => generated 344 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 11:07:06.972787 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-0708df3f-884a-4f15-9d49-9d562f75b797 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:07:06.973406 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-0708df3f-884a-4f15-9d49-9d562f75b797 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] [instance: 08091fd4-fdee-47e2-8f4c-772622ff2837] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:07:06.979784 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-0708df3f-884a-4f15-9d49-9d562f75b797 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:07:06.980235 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-0708df3f-884a-4f15-9d49-9d562f75b797 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:07:06.981025 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-0708df3f-884a-4f15-9d49-9d562f75b797 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:07:06.981463 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-0708df3f-884a-4f15-9d49-9d562f75b797 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:07:07.116747 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-0708df3f-884a-4f15-9d49-9d562f75b797 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7509ddedcec74149bb850e4adf64b489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb052a6c83084dd9bdbf408ad8870c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:07:07.124971 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-0708df3f-884a-4f15-9d49-9d562f75b797 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] 10.222.0.115 "GET /compute/v2.1/servers/08091fd4-fdee-47e2-8f4c-772622ff2837" status: 200 len: 1551 microversion: 2.1 time: 0.156461 Aug 02 11:07:07.126042 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 560/1111] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:07:06 2022] GET /compute/v2.1/servers/08091fd4-fdee-47e2-8f4c-772622ff2837 => generated 1551 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:07:09.009445 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-f8416e00-37fe-4fb3-97d4-2ffa9e1198c3 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1b782634-7e52-464b-a26c-ab88cf0d59e7"}} {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 11:07:09.011860 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-f8416e00-37fe-4fb3-97d4-2ffa9e1198c3 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] [instance: 08091fd4-fdee-47e2-8f4c-772622ff2837] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:07:09.018746 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-f8416e00-37fe-4fb3-97d4-2ffa9e1198c3 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:07:09.019247 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-f8416e00-37fe-4fb3-97d4-2ffa9e1198c3 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:07:09.020062 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-f8416e00-37fe-4fb3-97d4-2ffa9e1198c3 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:07:09.020499 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-f8416e00-37fe-4fb3-97d4-2ffa9e1198c3 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:07:09.734418 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-f8416e00-37fe-4fb3-97d4-2ffa9e1198c3 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] 10.222.0.115 "POST /compute/v2.1/servers/08091fd4-fdee-47e2-8f4c-772622ff2837/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.728150 Aug 02 11:07:09.735221 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 552/1112] 10.222.0.115 () {60 vars in 1328 bytes} [Tue Aug 2 11:07:09 2022] POST /compute/v2.1/servers/08091fd4-fdee-47e2-8f4c-772622ff2837/os-volume_attachments => generated 194 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 11:07:17.336776 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-96959edc-74af-41e8-be60-76126dad422f tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:07:17.337552 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-96959edc-74af-41e8-be60-76126dad422f tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] [instance: 08091fd4-fdee-47e2-8f4c-772622ff2837] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:07:17.339547 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG dbcounter [-] [129953] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=129953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 11:07:17.340202 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG dbcounter [-] [129953] Writing DB stats nova_cell1:SELECT=64 {{(pid=129953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 11:07:17.348269 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-96959edc-74af-41e8-be60-76126dad422f tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:07:17.351153 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-96959edc-74af-41e8-be60-76126dad422f tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:07:17.351153 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-96959edc-74af-41e8-be60-76126dad422f tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:07:17.351153 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-96959edc-74af-41e8-be60-76126dad422f tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:07:17.497712 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-96959edc-74af-41e8-be60-76126dad422f tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7509ddedcec74149bb850e4adf64b489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb052a6c83084dd9bdbf408ad8870c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:07:17.506729 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-96959edc-74af-41e8-be60-76126dad422f tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] 10.222.0.115 "GET /compute/v2.1/servers/08091fd4-fdee-47e2-8f4c-772622ff2837" status: 200 len: 1597 microversion: 2.1 time: 0.173983 Aug 02 11:07:17.507749 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 561/1113] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:07:17 2022] GET /compute/v2.1/servers/08091fd4-fdee-47e2-8f4c-772622ff2837 => generated 1597 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:07:19.666996 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG dbcounter [-] [129952] Writing DB stats nova_cell0:SELECT=2 {{(pid=129952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 11:07:19.668199 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG dbcounter [-] [129952] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=129952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 11:07:19.675427 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG dbcounter [-] [129952] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 11:07:19.729416 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [req-31c4ff38-2f64-4607-b8da-18c810208261 req-31e08d34-c03c-42f7-acfb-54db354a990f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08091fd4-fdee-47e2-8f4c-772622ff2837", "tag": "eab89b32-bc20-4112-a7c7-fa0ff15d11d9"}]} {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 11:07:19.739674 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [req-31c4ff38-2f64-4607-b8da-18c810208261 req-31e08d34-c03c-42f7-acfb-54db354a990f service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:07:19.740125 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [req-31c4ff38-2f64-4607-b8da-18c810208261 req-31e08d34-c03c-42f7-acfb-54db354a990f service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:07:19.752209 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.compute.server_external_events [req-31c4ff38-2f64-4607-b8da-18c810208261 req-31e08d34-c03c-42f7-acfb-54db354a990f service nova] Creating event network-changed:eab89b32-bc20-4112-a7c7-fa0ff15d11d9 for instance 08091fd4-fdee-47e2-8f4c-772622ff2837 on hv-cinder-85031 Aug 02 11:07:19.757502 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [req-31c4ff38-2f64-4607-b8da-18c810208261 req-31e08d34-c03c-42f7-acfb-54db354a990f service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095581 Aug 02 11:07:19.758519 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 553/1114] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Aug 2 11:07:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 11:07:22.189740 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-fb6f3053-fc02-4004-be21-e09c8229ad42 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-605545742"}} {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 11:07:22.190274 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-fb6f3053-fc02-4004-be21-e09c8229ad42 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] [instance: 08091fd4-fdee-47e2-8f4c-772622ff2837] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:07:22.196898 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-fb6f3053-fc02-4004-be21-e09c8229ad42 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:07:22.197353 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-fb6f3053-fc02-4004-be21-e09c8229ad42 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:07:22.198113 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-fb6f3053-fc02-4004-be21-e09c8229ad42 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:07:22.198545 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-fb6f3053-fc02-4004-be21-e09c8229ad42 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:07:22.326712 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.network.security_group_api [None req-fb6f3053-fc02-4004-be21-e09c8229ad42 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Adding security group 8d26323d-8520-458e-8abb-73f40b88571a to port eab89b32-bc20-4112-a7c7-fa0ff15d11d9 Aug 02 11:07:22.986663 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-fb6f3053-fc02-4004-be21-e09c8229ad42 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] 10.222.0.115 "POST /compute/v2.1/servers/08091fd4-fdee-47e2-8f4c-772622ff2837/action" status: 202 len: 0 microversion: 2.1 time: 0.800109 Aug 02 11:07:22.986663 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 562/1115] 10.222.0.115 () {60 vars in 1283 bytes} [Tue Aug 2 11:07:22 2022] POST /compute/v2.1/servers/08091fd4-fdee-47e2-8f4c-772622ff2837/action => generated 0 bytes in 802 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 02 11:07:23.002018 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-6a139286-878a-450a-ab78-60e80c818a5d tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:07:23.002450 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-6a139286-878a-450a-ab78-60e80c818a5d tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] [instance: 08091fd4-fdee-47e2-8f4c-772622ff2837] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:07:23.004219 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [req-c359280a-f24a-4fce-821e-4e7bd9da94bb req-a983d3a6-6797-4ef0-9fd0-03f6737cd377 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08091fd4-fdee-47e2-8f4c-772622ff2837", "tag": "eab89b32-bc20-4112-a7c7-fa0ff15d11d9"}]} {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 11:07:23.017305 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [req-c359280a-f24a-4fce-821e-4e7bd9da94bb req-a983d3a6-6797-4ef0-9fd0-03f6737cd377 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:07:23.018127 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [req-c359280a-f24a-4fce-821e-4e7bd9da94bb req-a983d3a6-6797-4ef0-9fd0-03f6737cd377 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:07:23.018252 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-6a139286-878a-450a-ab78-60e80c818a5d tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:07:23.019877 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-6a139286-878a-450a-ab78-60e80c818a5d tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:07:23.021108 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-6a139286-878a-450a-ab78-60e80c818a5d tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:07:23.021844 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-6a139286-878a-450a-ab78-60e80c818a5d tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:07:23.034131 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.compute.server_external_events [req-c359280a-f24a-4fce-821e-4e7bd9da94bb req-a983d3a6-6797-4ef0-9fd0-03f6737cd377 service nova] Creating event network-changed:eab89b32-bc20-4112-a7c7-fa0ff15d11d9 for instance 08091fd4-fdee-47e2-8f4c-772622ff2837 on hv-cinder-85031 Aug 02 11:07:23.050853 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [req-c359280a-f24a-4fce-821e-4e7bd9da94bb req-a983d3a6-6797-4ef0-9fd0-03f6737cd377 service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060815 Aug 02 11:07:23.052950 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 554/1116] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Aug 2 11:07:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 11:07:23.303906 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-6a139286-878a-450a-ab78-60e80c818a5d tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7509ddedcec74149bb850e4adf64b489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb052a6c83084dd9bdbf408ad8870c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:07:23.314697 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-6a139286-878a-450a-ab78-60e80c818a5d tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] 10.222.0.115 "GET /compute/v2.1/servers/08091fd4-fdee-47e2-8f4c-772622ff2837" status: 200 len: 1762 microversion: 2.1 time: 0.317785 Aug 02 11:07:23.315880 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 563/1117] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:07:22 2022] GET /compute/v2.1/servers/08091fd4-fdee-47e2-8f4c-772622ff2837 => generated 1762 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:07:39.213218 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG dbcounter [-] [129952] Writing DB stats nova_api:SELECT=4 {{(pid=129952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 11:07:39.216703 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-868c4cad-fb10-4f5a-923d-da3ab7294f18 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 11:07:39.219800 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-868c4cad-fb10-4f5a-923d-da3ab7294f18 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] [instance: 08091fd4-fdee-47e2-8f4c-772622ff2837] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:07:39.226675 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-868c4cad-fb10-4f5a-923d-da3ab7294f18 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:07:39.227225 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-868c4cad-fb10-4f5a-923d-da3ab7294f18 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:07:39.228031 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-868c4cad-fb10-4f5a-923d-da3ab7294f18 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:07:39.228470 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-868c4cad-fb10-4f5a-923d-da3ab7294f18 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:07:39.469065 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-868c4cad-fb10-4f5a-923d-da3ab7294f18 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] 10.222.0.115 "POST /compute/v2.1/servers/08091fd4-fdee-47e2-8f4c-772622ff2837/action" status: 202 len: 0 microversion: 2.1 time: 0.257925 Aug 02 11:07:39.477027 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 555/1118] 10.222.0.115 () {60 vars in 1283 bytes} [Tue Aug 2 11:07:39 2022] POST /compute/v2.1/servers/08091fd4-fdee-47e2-8f4c-772622ff2837/action => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 11:07:39.477816 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-9ba33c58-5ac6-429c-8667-d0c42d7723fe tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:07:39.478435 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-9ba33c58-5ac6-429c-8667-d0c42d7723fe tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] [instance: 08091fd4-fdee-47e2-8f4c-772622ff2837] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:07:39.481122 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG dbcounter [-] [129953] Writing DB stats nova_api:SELECT=6 {{(pid=129953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 11:07:39.481833 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG dbcounter [-] [129953] Writing DB stats nova_cell1:SELECT=16 {{(pid=129953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 11:07:39.486784 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-9ba33c58-5ac6-429c-8667-d0c42d7723fe tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:07:39.487270 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-9ba33c58-5ac6-429c-8667-d0c42d7723fe tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:07:39.488049 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-9ba33c58-5ac6-429c-8667-d0c42d7723fe tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:07:39.488488 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-9ba33c58-5ac6-429c-8667-d0c42d7723fe tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:07:39.643976 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-9ba33c58-5ac6-429c-8667-d0c42d7723fe tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7509ddedcec74149bb850e4adf64b489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb052a6c83084dd9bdbf408ad8870c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:07:39.653160 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-9ba33c58-5ac6-429c-8667-d0c42d7723fe tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] 10.222.0.115 "GET /compute/v2.1/servers/08091fd4-fdee-47e2-8f4c-772622ff2837" status: 200 len: 1754 microversion: 2.1 time: 0.178935 Aug 02 11:07:39.654761 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 564/1119] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:07:39 2022] GET /compute/v2.1/servers/08091fd4-fdee-47e2-8f4c-772622ff2837 => generated 1754 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:07:40.674764 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-c009376a-a95d-4d92-ac06-5f00922d290b tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:07:40.675489 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-c009376a-a95d-4d92-ac06-5f00922d290b tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] [instance: 08091fd4-fdee-47e2-8f4c-772622ff2837] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:07:40.682218 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-c009376a-a95d-4d92-ac06-5f00922d290b tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:07:40.682667 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-c009376a-a95d-4d92-ac06-5f00922d290b tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:07:40.683473 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-c009376a-a95d-4d92-ac06-5f00922d290b tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:07:40.683908 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-c009376a-a95d-4d92-ac06-5f00922d290b tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:07:40.835483 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-c009376a-a95d-4d92-ac06-5f00922d290b tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7509ddedcec74149bb850e4adf64b489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb052a6c83084dd9bdbf408ad8870c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:07:40.843397 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-c009376a-a95d-4d92-ac06-5f00922d290b tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] 10.222.0.115 "GET /compute/v2.1/servers/08091fd4-fdee-47e2-8f4c-772622ff2837" status: 200 len: 1759 microversion: 2.1 time: 0.172872 Aug 02 11:07:40.843959 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 556/1120] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:07:40 2022] GET /compute/v2.1/servers/08091fd4-fdee-47e2-8f4c-772622ff2837 => generated 1759 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:07:41.865226 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-f3371251-1456-46b4-9b94-370a7e1d5ed0 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:07:41.865847 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-f3371251-1456-46b4-9b94-370a7e1d5ed0 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] [instance: 08091fd4-fdee-47e2-8f4c-772622ff2837] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:07:41.873325 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-f3371251-1456-46b4-9b94-370a7e1d5ed0 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:07:41.873858 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-f3371251-1456-46b4-9b94-370a7e1d5ed0 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:07:41.874640 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-f3371251-1456-46b4-9b94-370a7e1d5ed0 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:07:41.875105 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-f3371251-1456-46b4-9b94-370a7e1d5ed0 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:07:42.022788 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-f3371251-1456-46b4-9b94-370a7e1d5ed0 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7509ddedcec74149bb850e4adf64b489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb052a6c83084dd9bdbf408ad8870c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:07:42.031882 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-f3371251-1456-46b4-9b94-370a7e1d5ed0 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] 10.222.0.115 "GET /compute/v2.1/servers/08091fd4-fdee-47e2-8f4c-772622ff2837" status: 200 len: 1759 microversion: 2.1 time: 0.170514 Aug 02 11:07:42.032455 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 565/1121] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:07:41 2022] GET /compute/v2.1/servers/08091fd4-fdee-47e2-8f4c-772622ff2837 => generated 1759 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:07:43.053870 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-4596083e-3dad-4e54-825e-af9bf5b8b465 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:07:43.054505 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-4596083e-3dad-4e54-825e-af9bf5b8b465 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] [instance: 08091fd4-fdee-47e2-8f4c-772622ff2837] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:07:43.061175 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-4596083e-3dad-4e54-825e-af9bf5b8b465 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:07:43.061624 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-4596083e-3dad-4e54-825e-af9bf5b8b465 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:07:43.062386 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-4596083e-3dad-4e54-825e-af9bf5b8b465 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:07:43.062822 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-4596083e-3dad-4e54-825e-af9bf5b8b465 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:07:43.207464 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-4596083e-3dad-4e54-825e-af9bf5b8b465 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7509ddedcec74149bb850e4adf64b489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb052a6c83084dd9bdbf408ad8870c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:07:43.215480 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-4596083e-3dad-4e54-825e-af9bf5b8b465 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] 10.222.0.115 "GET /compute/v2.1/servers/08091fd4-fdee-47e2-8f4c-772622ff2837" status: 200 len: 1759 microversion: 2.1 time: 0.165536 Aug 02 11:07:43.216056 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 557/1122] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:07:43 2022] GET /compute/v2.1/servers/08091fd4-fdee-47e2-8f4c-772622ff2837 => generated 1759 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:07:44.237980 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-53a5b191-f362-4090-801f-1b19d5f615c3 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:07:44.238692 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-53a5b191-f362-4090-801f-1b19d5f615c3 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] [instance: 08091fd4-fdee-47e2-8f4c-772622ff2837] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:07:44.248875 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-53a5b191-f362-4090-801f-1b19d5f615c3 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:07:44.249338 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-53a5b191-f362-4090-801f-1b19d5f615c3 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:07:44.250193 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-53a5b191-f362-4090-801f-1b19d5f615c3 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:07:44.250626 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-53a5b191-f362-4090-801f-1b19d5f615c3 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:07:44.401941 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-53a5b191-f362-4090-801f-1b19d5f615c3 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7509ddedcec74149bb850e4adf64b489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb052a6c83084dd9bdbf408ad8870c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:07:44.410729 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-53a5b191-f362-4090-801f-1b19d5f615c3 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] 10.222.0.115 "GET /compute/v2.1/servers/08091fd4-fdee-47e2-8f4c-772622ff2837" status: 200 len: 1759 microversion: 2.1 time: 0.176637 Aug 02 11:07:44.411353 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 566/1123] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:07:44 2022] GET /compute/v2.1/servers/08091fd4-fdee-47e2-8f4c-772622ff2837 => generated 1759 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:07:45.433124 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-dee6f433-ebda-4ac4-997c-43d065d45504 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:07:45.433682 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-dee6f433-ebda-4ac4-997c-43d065d45504 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] [instance: 08091fd4-fdee-47e2-8f4c-772622ff2837] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:07:45.441212 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-dee6f433-ebda-4ac4-997c-43d065d45504 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:07:45.441658 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-dee6f433-ebda-4ac4-997c-43d065d45504 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:07:45.442432 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-dee6f433-ebda-4ac4-997c-43d065d45504 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:07:45.442864 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-dee6f433-ebda-4ac4-997c-43d065d45504 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:07:45.599309 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-dee6f433-ebda-4ac4-997c-43d065d45504 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7509ddedcec74149bb850e4adf64b489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb052a6c83084dd9bdbf408ad8870c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:07:45.607438 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-dee6f433-ebda-4ac4-997c-43d065d45504 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] 10.222.0.115 "GET /compute/v2.1/servers/08091fd4-fdee-47e2-8f4c-772622ff2837" status: 200 len: 1759 microversion: 2.1 time: 0.178238 Aug 02 11:07:45.608015 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 558/1124] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:07:45 2022] GET /compute/v2.1/servers/08091fd4-fdee-47e2-8f4c-772622ff2837 => generated 1759 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:07:46.629439 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-e7c00291-4253-40b1-9c6a-fc76f8fb03aa tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:07:46.630042 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-e7c00291-4253-40b1-9c6a-fc76f8fb03aa tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] [instance: 08091fd4-fdee-47e2-8f4c-772622ff2837] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:07:46.636613 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-e7c00291-4253-40b1-9c6a-fc76f8fb03aa tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:07:46.637307 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-e7c00291-4253-40b1-9c6a-fc76f8fb03aa tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:07:46.638055 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-e7c00291-4253-40b1-9c6a-fc76f8fb03aa tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:07:46.638483 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-e7c00291-4253-40b1-9c6a-fc76f8fb03aa tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:07:46.779511 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-e7c00291-4253-40b1-9c6a-fc76f8fb03aa tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7509ddedcec74149bb850e4adf64b489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb052a6c83084dd9bdbf408ad8870c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:07:46.787644 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-e7c00291-4253-40b1-9c6a-fc76f8fb03aa tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] 10.222.0.115 "GET /compute/v2.1/servers/08091fd4-fdee-47e2-8f4c-772622ff2837" status: 200 len: 1759 microversion: 2.1 time: 0.162067 Aug 02 11:07:46.788215 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 567/1125] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:07:46 2022] GET /compute/v2.1/servers/08091fd4-fdee-47e2-8f4c-772622ff2837 => generated 1759 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:07:47.809275 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-4089bdb7-4eeb-4cca-9f95-a2290c888224 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:07:47.809879 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-4089bdb7-4eeb-4cca-9f95-a2290c888224 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] [instance: 08091fd4-fdee-47e2-8f4c-772622ff2837] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:07:47.817360 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-4089bdb7-4eeb-4cca-9f95-a2290c888224 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:07:47.817806 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-4089bdb7-4eeb-4cca-9f95-a2290c888224 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:07:47.818560 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-4089bdb7-4eeb-4cca-9f95-a2290c888224 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:07:47.818986 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-4089bdb7-4eeb-4cca-9f95-a2290c888224 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:07:47.958508 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-4089bdb7-4eeb-4cca-9f95-a2290c888224 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7509ddedcec74149bb850e4adf64b489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb052a6c83084dd9bdbf408ad8870c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:07:47.966446 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-4089bdb7-4eeb-4cca-9f95-a2290c888224 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] 10.222.0.115 "GET /compute/v2.1/servers/08091fd4-fdee-47e2-8f4c-772622ff2837" status: 200 len: 1759 microversion: 2.1 time: 0.161053 Aug 02 11:07:47.967015 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 559/1126] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:07:47 2022] GET /compute/v2.1/servers/08091fd4-fdee-47e2-8f4c-772622ff2837 => generated 1759 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:07:48.987832 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-1bdcf537-3845-42b1-9059-e7a067a7e4ba tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:07:48.988429 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-1bdcf537-3845-42b1-9059-e7a067a7e4ba tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] [instance: 08091fd4-fdee-47e2-8f4c-772622ff2837] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:07:48.994914 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-1bdcf537-3845-42b1-9059-e7a067a7e4ba tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:07:48.995397 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-1bdcf537-3845-42b1-9059-e7a067a7e4ba tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:07:48.996154 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-1bdcf537-3845-42b1-9059-e7a067a7e4ba tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:07:48.996587 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-1bdcf537-3845-42b1-9059-e7a067a7e4ba tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:07:49.141382 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-1bdcf537-3845-42b1-9059-e7a067a7e4ba tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7509ddedcec74149bb850e4adf64b489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb052a6c83084dd9bdbf408ad8870c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:07:49.149351 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-1bdcf537-3845-42b1-9059-e7a067a7e4ba tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] 10.222.0.115 "GET /compute/v2.1/servers/08091fd4-fdee-47e2-8f4c-772622ff2837" status: 200 len: 1759 microversion: 2.1 time: 0.165432 Aug 02 11:07:49.149916 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 568/1127] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:07:48 2022] GET /compute/v2.1/servers/08091fd4-fdee-47e2-8f4c-772622ff2837 => generated 1759 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:07:50.172060 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-695871ec-bf3a-4cf0-b273-0b1cf41c9dfc tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:07:50.172980 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-695871ec-bf3a-4cf0-b273-0b1cf41c9dfc tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] [instance: 08091fd4-fdee-47e2-8f4c-772622ff2837] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:07:50.179632 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-695871ec-bf3a-4cf0-b273-0b1cf41c9dfc tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:07:50.180077 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-695871ec-bf3a-4cf0-b273-0b1cf41c9dfc tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:07:50.180833 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-695871ec-bf3a-4cf0-b273-0b1cf41c9dfc tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:07:50.181267 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-695871ec-bf3a-4cf0-b273-0b1cf41c9dfc tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:07:50.322857 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-695871ec-bf3a-4cf0-b273-0b1cf41c9dfc tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7509ddedcec74149bb850e4adf64b489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb052a6c83084dd9bdbf408ad8870c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:07:50.331497 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-695871ec-bf3a-4cf0-b273-0b1cf41c9dfc tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] 10.222.0.115 "GET /compute/v2.1/servers/08091fd4-fdee-47e2-8f4c-772622ff2837" status: 200 len: 1759 microversion: 2.1 time: 0.164116 Aug 02 11:07:50.332059 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 560/1128] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:07:50 2022] GET /compute/v2.1/servers/08091fd4-fdee-47e2-8f4c-772622ff2837 => generated 1759 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 11:07:51.354769 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-606423c7-ea25-47bc-afda-669aae15c868 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:07:51.355599 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-606423c7-ea25-47bc-afda-669aae15c868 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] [instance: 08091fd4-fdee-47e2-8f4c-772622ff2837] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:07:51.363238 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-606423c7-ea25-47bc-afda-669aae15c868 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:07:51.363690 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-606423c7-ea25-47bc-afda-669aae15c868 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:07:51.364464 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-606423c7-ea25-47bc-afda-669aae15c868 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:07:51.364907 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-606423c7-ea25-47bc-afda-669aae15c868 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:07:51.521246 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-606423c7-ea25-47bc-afda-669aae15c868 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7509ddedcec74149bb850e4adf64b489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb052a6c83084dd9bdbf408ad8870c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:07:51.529331 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-606423c7-ea25-47bc-afda-669aae15c868 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] 10.222.0.115 "GET /compute/v2.1/servers/08091fd4-fdee-47e2-8f4c-772622ff2837" status: 200 len: 1762 microversion: 2.1 time: 0.178766 Aug 02 11:07:51.530425 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 569/1129] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:07:51 2022] GET /compute/v2.1/servers/08091fd4-fdee-47e2-8f4c-772622ff2837 => generated 1762 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:08:24.210071 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-d3ad6b82-fece-4ad8-bca9-df3d43fef85b tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-605545742"}} {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 11:08:24.210763 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-d3ad6b82-fece-4ad8-bca9-df3d43fef85b tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] [instance: 08091fd4-fdee-47e2-8f4c-772622ff2837] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:08:24.212968 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG dbcounter [-] [129952] Writing DB stats nova_api:SELECT=12 {{(pid=129952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 11:08:24.213627 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG dbcounter [-] [129952] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 11:08:24.219628 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-d3ad6b82-fece-4ad8-bca9-df3d43fef85b tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:08:24.226695 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-d3ad6b82-fece-4ad8-bca9-df3d43fef85b tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:08:24.226695 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-d3ad6b82-fece-4ad8-bca9-df3d43fef85b tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:08:24.226695 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-d3ad6b82-fece-4ad8-bca9-df3d43fef85b tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:08:24.347666 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.network.security_group_api [None req-d3ad6b82-fece-4ad8-bca9-df3d43fef85b tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Removing security group 8d26323d-8520-458e-8abb-73f40b88571a from port eab89b32-bc20-4112-a7c7-fa0ff15d11d9 Aug 02 11:08:24.697586 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-d3ad6b82-fece-4ad8-bca9-df3d43fef85b tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] 10.222.0.115 "POST /compute/v2.1/servers/08091fd4-fdee-47e2-8f4c-772622ff2837/action" status: 202 len: 0 microversion: 2.1 time: 0.489306 Aug 02 11:08:24.697586 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 561/1130] 10.222.0.115 () {60 vars in 1283 bytes} [Tue Aug 2 11:08:24 2022] POST /compute/v2.1/servers/08091fd4-fdee-47e2-8f4c-772622ff2837/action => generated 0 bytes in 491 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 02 11:08:24.705259 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [req-57d02d1a-e6ea-4e2e-9cf3-65595b48ffee req-0156f550-7c95-4d7e-aae9-d3c7110909a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08091fd4-fdee-47e2-8f4c-772622ff2837", "tag": "eab89b32-bc20-4112-a7c7-fa0ff15d11d9"}]} {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 11:08:24.715669 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG dbcounter [-] [129953] Writing DB stats nova_api:SELECT=12 {{(pid=129953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 11:08:24.717099 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG dbcounter [-] [129953] Writing DB stats nova_cell1:SELECT=36 {{(pid=129953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 11:08:24.719732 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [req-57d02d1a-e6ea-4e2e-9cf3-65595b48ffee req-0156f550-7c95-4d7e-aae9-d3c7110909a3 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:08:24.720492 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [req-57d02d1a-e6ea-4e2e-9cf3-65595b48ffee req-0156f550-7c95-4d7e-aae9-d3c7110909a3 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:08:24.734890 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.compute.server_external_events [req-57d02d1a-e6ea-4e2e-9cf3-65595b48ffee req-0156f550-7c95-4d7e-aae9-d3c7110909a3 service nova] Creating event network-changed:eab89b32-bc20-4112-a7c7-fa0ff15d11d9 for instance 08091fd4-fdee-47e2-8f4c-772622ff2837 on hv-cinder-85031 Aug 02 11:08:24.741711 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [req-57d02d1a-e6ea-4e2e-9cf3-65595b48ffee req-0156f550-7c95-4d7e-aae9-d3c7110909a3 service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040489 Aug 02 11:08:24.742663 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 570/1131] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Aug 2 11:08:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 11:08:25.906503 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-d8554220-c8a4-44dd-bba0-005df8a26c53 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:08:25.907715 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-d8554220-c8a4-44dd-bba0-005df8a26c53 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] [instance: 08091fd4-fdee-47e2-8f4c-772622ff2837] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:08:25.908170 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [req-c5835e06-1e35-4544-992d-1ffe9f80339c req-3af54680-96a7-45de-8dea-18b3e082bb45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08091fd4-fdee-47e2-8f4c-772622ff2837", "tag": "eab89b32-bc20-4112-a7c7-fa0ff15d11d9"}]} {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 11:08:25.914026 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-d8554220-c8a4-44dd-bba0-005df8a26c53 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:08:25.914475 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-d8554220-c8a4-44dd-bba0-005df8a26c53 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:08:25.915481 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-d8554220-c8a4-44dd-bba0-005df8a26c53 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:08:25.915924 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-d8554220-c8a4-44dd-bba0-005df8a26c53 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:08:25.919584 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [req-c5835e06-1e35-4544-992d-1ffe9f80339c req-3af54680-96a7-45de-8dea-18b3e082bb45 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:08:25.920245 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [req-c5835e06-1e35-4544-992d-1ffe9f80339c req-3af54680-96a7-45de-8dea-18b3e082bb45 service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:08:25.932061 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.compute.server_external_events [req-c5835e06-1e35-4544-992d-1ffe9f80339c req-3af54680-96a7-45de-8dea-18b3e082bb45 service nova] Creating event network-changed:eab89b32-bc20-4112-a7c7-fa0ff15d11d9 for instance 08091fd4-fdee-47e2-8f4c-772622ff2837 on hv-cinder-85031 Aug 02 11:08:25.937771 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [req-c5835e06-1e35-4544-992d-1ffe9f80339c req-3af54680-96a7-45de-8dea-18b3e082bb45 service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033644 Aug 02 11:08:25.938470 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 571/1132] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Aug 2 11:08:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 11:08:26.013541 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.objects.instance [None req-d8554220-c8a4-44dd-bba0-005df8a26c53 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lazy-loading 'services' on Instance uuid 08091fd4-fdee-47e2-8f4c-772622ff2837 {{(pid=129952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 11:08:26.220018 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-d8554220-c8a4-44dd-bba0-005df8a26c53 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] 10.222.0.115 "DELETE /compute/v2.1/servers/08091fd4-fdee-47e2-8f4c-772622ff2837/os-volume_attachments/1b782634-7e52-464b-a26c-ab88cf0d59e7" status: 202 len: 0 microversion: 2.1 time: 0.315836 Aug 02 11:08:26.222093 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 562/1133] 10.222.0.115 () {58 vars in 1421 bytes} [Tue Aug 2 11:08:25 2022] DELETE /compute/v2.1/servers/08091fd4-fdee-47e2-8f4c-772622ff2837/os-volume_attachments/1b782634-7e52-464b-a26c-ab88cf0d59e7 => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 11:08:26.228993 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-99157b9e-4121-446d-8791-e2c8d7f6e9d3 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:08:26.232779 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-99157b9e-4121-446d-8791-e2c8d7f6e9d3 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] [instance: 08091fd4-fdee-47e2-8f4c-772622ff2837] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:08:26.240912 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-99157b9e-4121-446d-8791-e2c8d7f6e9d3 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:08:26.245216 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-99157b9e-4121-446d-8791-e2c8d7f6e9d3 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:08:26.245216 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-99157b9e-4121-446d-8791-e2c8d7f6e9d3 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:08:26.245216 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-99157b9e-4121-446d-8791-e2c8d7f6e9d3 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:08:26.275672 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-99157b9e-4121-446d-8791-e2c8d7f6e9d3 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] 10.222.0.115 "GET /compute/v2.1/servers/08091fd4-fdee-47e2-8f4c-772622ff2837/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052127 Aug 02 11:08:26.276248 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 572/1134] 10.222.0.115 () {58 vars in 1307 bytes} [Tue Aug 2 11:08:26 2022] GET /compute/v2.1/servers/08091fd4-fdee-47e2-8f4c-772622ff2837/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 11:08:27.289783 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-78035822-2429-45fa-9408-bcd4ae33897f tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:08:27.292132 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-78035822-2429-45fa-9408-bcd4ae33897f tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] [instance: 08091fd4-fdee-47e2-8f4c-772622ff2837] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:08:27.298491 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-78035822-2429-45fa-9408-bcd4ae33897f tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:08:27.299191 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-78035822-2429-45fa-9408-bcd4ae33897f tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:08:27.299958 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-78035822-2429-45fa-9408-bcd4ae33897f tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:08:27.300398 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-78035822-2429-45fa-9408-bcd4ae33897f tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:08:27.331543 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-78035822-2429-45fa-9408-bcd4ae33897f tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] 10.222.0.115 "GET /compute/v2.1/servers/08091fd4-fdee-47e2-8f4c-772622ff2837/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046507 Aug 02 11:08:27.332111 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 563/1135] 10.222.0.115 () {58 vars in 1307 bytes} [Tue Aug 2 11:08:27 2022] GET /compute/v2.1/servers/08091fd4-fdee-47e2-8f4c-772622ff2837/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 11:08:27.342622 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-0d77904d-ccc9-4341-b82b-dc3eeb88e6e3 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:08:27.350305 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-0d77904d-ccc9-4341-b82b-dc3eeb88e6e3 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] [instance: 08091fd4-fdee-47e2-8f4c-772622ff2837] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:08:27.350305 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-0d77904d-ccc9-4341-b82b-dc3eeb88e6e3 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:08:27.350305 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-0d77904d-ccc9-4341-b82b-dc3eeb88e6e3 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:08:27.350916 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-0d77904d-ccc9-4341-b82b-dc3eeb88e6e3 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:08:27.351384 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-0d77904d-ccc9-4341-b82b-dc3eeb88e6e3 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:08:27.426552 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.wsgi [None req-0d77904d-ccc9-4341-b82b-dc3eeb88e6e3 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] HTTP exception thrown: Instance 08091fd4-fdee-47e2-8f4c-772622ff2837 is not attached to volume 1b782634-7e52-464b-a26c-ab88cf0d59e7 Aug 02 11:08:27.428926 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-0d77904d-ccc9-4341-b82b-dc3eeb88e6e3 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Request method failure captured: Aug 02 11:08:27.428926 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: request: DELETE /compute/v2.1/servers/08091fd4-fdee-47e2-8f4c-772622ff2837/os-volume_attachments/1b782634-7e52-464b-a26c-ab88cf0d59e7 HTTP/1.1 Aug 02 11:08:27.428926 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Accept: application/json Aug 02 11:08:27.428926 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Accept-Encoding: identity Aug 02 11:08:27.428926 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Connection: close Aug 02 11:08:27.428926 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Content-Length: 0 Aug 02 11:08:27.428926 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Content-Type: application/json Aug 02 11:08:27.428926 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Host: 10.222.0.115 Aug 02 11:08:27.428926 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Openstack-System-Scope: None Aug 02 11:08:27.428926 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: User-Agent: python-urllib3/1.26.10 Aug 02 11:08:27.428926 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Auth-Token: gAAAAABi6QUwpwgdFseFkJH3QUoTnvGDz6UkqUf73miduRaPUHdpJD2yytZBoWq5zHgzcmb8PDH7jw9dboq-hdG6OCKwcky-4yYFnxRlFKWGkgLx69xZGeTizEK8xZck84woHT4dT_rOEyU9p_yq81aOg4BF-jOXRF7JTOarhjMPU81EFjir4nQ Aug 02 11:08:27.428926 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Domain-Id: None Aug 02 11:08:27.428926 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Domain-Name: None Aug 02 11:08:27.428926 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Identity-Status: Confirmed Aug 02 11:08:27.428926 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Is-Admin-Project: True Aug 02 11:08:27.428926 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Project-Domain-Id: default Aug 02 11:08:27.428926 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Project-Domain-Name: Default Aug 02 11:08:27.428926 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Project-Id: bb052a6c83084dd9bdbf408ad8870c16 Aug 02 11:08:27.428926 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Project-Name: tempest-TestMinimumBasicScenario-563232411 Aug 02 11:08:27.428926 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Role: reader,member Aug 02 11:08:27.428926 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Roles: reader,member Aug 02 11:08:27.430818 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/bb052a6c83084dd9bdbf408ad8870c16"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2/bb052a6c83084dd9bdbf408ad8870c16"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/bb052a6c83084dd9bdbf408ad8870c16"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.115:8080", "publicURL": "http://10.222.0.115:8080/v1/AUTH_bb052a6c83084dd9bdbf408ad8870c16"}]}] Aug 02 11:08:27.430818 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Tenant: tempest-TestMinimumBasicScenario-563232411 Aug 02 11:08:27.430818 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Tenant-Id: bb052a6c83084dd9bdbf408ad8870c16 Aug 02 11:08:27.430818 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-Tenant-Name: tempest-TestMinimumBasicScenario-563232411 Aug 02 11:08:27.430818 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User: tempest-TestMinimumBasicScenario-563232411-project Aug 02 11:08:27.430818 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User-Domain-Id: default Aug 02 11:08:27.430818 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User-Domain-Name: Default Aug 02 11:08:27.430818 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User-Id: 7509ddedcec74149bb850e4adf64b489 Aug 02 11:08:27.430818 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: X-User-Name: tempest-TestMinimumBasicScenario-563232411-project Aug 02 11:08:27.430818 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: method: > Aug 02 11:08:27.430818 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: exception: Instance 08091fd4-fdee-47e2-8f4c-772622ff2837 is not attached to volume 1b782634-7e52-464b-a26c-ab88cf0d59e7 Aug 02 11:08:27.431862 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: action_args: {'server_id': '08091fd4-fdee-47e2-8f4c-772622ff2837', 'id': '1b782634-7e52-464b-a26c-ab88cf0d59e7'} Aug 02 11:08:27.431862 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 11:08:27.431862 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:08:27.431862 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 02 11:08:27.431862 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 02 11:08:27.431862 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 02 11:08:27.431862 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 02 11:08:27.431862 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 02 11:08:27.431862 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 02 11:08:27.431862 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 1b782634-7e52-464b-a26c-ab88cf0d59e7. Aug 02 11:08:27.431862 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 11:08:27.431862 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 11:08:27.431862 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 11:08:27.431862 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:08:27.431862 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 11:08:27.431862 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 11:08:27.431862 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 11:08:27.431862 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 11:08:27.431862 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 11:08:27.433601 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 11:08:27.433601 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 02 11:08:27.433601 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 02 11:08:27.433601 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08091fd4-fdee-47e2-8f4c-772622ff2837 is not attached to volume 1b782634-7e52-464b-a26c-ab88cf0d59e7 Aug 02 11:08:27.433601 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 11:08:27.433601 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 11:08:27.433601 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 11:08:27.433601 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:08:27.433601 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 11:08:27.433601 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 11:08:27.433601 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 11:08:27.433601 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 11:08:27.433601 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08091fd4-fdee-47e2-8f4c-772622ff2837 is not attached to volume 1b782634-7e52-464b-a26c-ab88cf0d59e7 Aug 02 11:08:27.433601 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: ERROR nova.api.openstack.wsgi Aug 02 11:08:27.433601 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-0d77904d-ccc9-4341-b82b-dc3eeb88e6e3 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Returning 404 to user: Instance 08091fd4-fdee-47e2-8f4c-772622ff2837 is not attached to volume 1b782634-7e52-464b-a26c-ab88cf0d59e7 {{(pid=129953) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 11:08:27.435106 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-0d77904d-ccc9-4341-b82b-dc3eeb88e6e3 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] 10.222.0.115 "DELETE /compute/v2.1/servers/08091fd4-fdee-47e2-8f4c-772622ff2837/os-volume_attachments/1b782634-7e52-464b-a26c-ab88cf0d59e7" status: 404 len: 154 microversion: 2.1 time: 0.091749 Aug 02 11:08:27.435106 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 573/1136] 10.222.0.115 () {58 vars in 1421 bytes} [Tue Aug 2 11:08:27 2022] DELETE /compute/v2.1/servers/08091fd4-fdee-47e2-8f4c-772622ff2837/os-volume_attachments/1b782634-7e52-464b-a26c-ab88cf0d59e7 => generated 154 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 11:08:28.704254 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-db0d6159-72c2-414e-9419-d3274027da67 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:08:28.704781 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-db0d6159-72c2-414e-9419-d3274027da67 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] [instance: 08091fd4-fdee-47e2-8f4c-772622ff2837] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:08:28.711371 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-db0d6159-72c2-414e-9419-d3274027da67 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:08:28.711814 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-db0d6159-72c2-414e-9419-d3274027da67 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:08:28.712566 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-db0d6159-72c2-414e-9419-d3274027da67 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:08:28.713070 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-db0d6159-72c2-414e-9419-d3274027da67 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:08:28.739176 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-db0d6159-72c2-414e-9419-d3274027da67 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] [instance: 08091fd4-fdee-47e2-8f4c-772622ff2837] Going to try to terminate instance {{(pid=129952) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 11:08:29.023824 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-db0d6159-72c2-414e-9419-d3274027da67 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] 10.222.0.115 "DELETE /compute/v2.1/servers/08091fd4-fdee-47e2-8f4c-772622ff2837" status: 204 len: 0 microversion: 2.1 time: 0.323148 Aug 02 11:08:29.024419 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 564/1137] 10.222.0.115 () {58 vars in 1244 bytes} [Tue Aug 2 11:08:28 2022] DELETE /compute/v2.1/servers/08091fd4-fdee-47e2-8f4c-772622ff2837 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 11:08:29.033302 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-e4f38822-d78d-4662-93ae-7c4733205c1d tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:08:29.038061 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-e4f38822-d78d-4662-93ae-7c4733205c1d tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] [instance: 08091fd4-fdee-47e2-8f4c-772622ff2837] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:08:29.040294 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-e4f38822-d78d-4662-93ae-7c4733205c1d tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:08:29.040742 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-e4f38822-d78d-4662-93ae-7c4733205c1d tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:08:29.041495 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-e4f38822-d78d-4662-93ae-7c4733205c1d tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:08:29.041921 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-e4f38822-d78d-4662-93ae-7c4733205c1d tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:08:29.174657 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-e4f38822-d78d-4662-93ae-7c4733205c1d tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7509ddedcec74149bb850e4adf64b489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb052a6c83084dd9bdbf408ad8870c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:08:29.182248 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-e4f38822-d78d-4662-93ae-7c4733205c1d tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] 10.222.0.115 "GET /compute/v2.1/servers/08091fd4-fdee-47e2-8f4c-772622ff2837" status: 200 len: 1557 microversion: 2.1 time: 0.153469 Aug 02 11:08:29.182808 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 574/1138] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:08:29 2022] GET /compute/v2.1/servers/08091fd4-fdee-47e2-8f4c-772622ff2837 => generated 1557 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:08:30.124710 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 11:08:30.125461 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Tue Aug 2 11:08:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 11:08:30.204578 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-69bfd6cf-8506-40eb-b096-756e4c62f5a8 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:08:30.205283 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-69bfd6cf-8506-40eb-b096-756e4c62f5a8 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] [instance: 08091fd4-fdee-47e2-8f4c-772622ff2837] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:08:30.212022 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-69bfd6cf-8506-40eb-b096-756e4c62f5a8 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:08:30.212477 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-69bfd6cf-8506-40eb-b096-756e4c62f5a8 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:08:30.213285 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-69bfd6cf-8506-40eb-b096-756e4c62f5a8 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:08:30.213721 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-69bfd6cf-8506-40eb-b096-756e4c62f5a8 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:08:30.345066 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.policy [None req-69bfd6cf-8506-40eb-b096-756e4c62f5a8 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7509ddedcec74149bb850e4adf64b489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb052a6c83084dd9bdbf408ad8870c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129952) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:08:30.352816 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-69bfd6cf-8506-40eb-b096-756e4c62f5a8 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] 10.222.0.115 "GET /compute/v2.1/servers/08091fd4-fdee-47e2-8f4c-772622ff2837" status: 200 len: 1557 microversion: 2.1 time: 0.152543 Aug 02 11:08:30.353378 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 565/1139] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:08:30 2022] GET /compute/v2.1/servers/08091fd4-fdee-47e2-8f4c-772622ff2837 => generated 1557 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:08:31.336644 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 11:08:31.337385 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Tue Aug 2 11:08:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 11:08:31.373976 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-1a255d96-d20b-4726-904b-52c700ee18ce tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Calling method '>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:08:31.374581 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.compute.api [None req-1a255d96-d20b-4726-904b-52c700ee18ce tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] [instance: 08091fd4-fdee-47e2-8f4c-772622ff2837] Fetching instance by UUID {{(pid=129953) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:08:31.381824 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-1a255d96-d20b-4726-904b-52c700ee18ce tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:08:31.382264 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-1a255d96-d20b-4726-904b-52c700ee18ce tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:08:31.383017 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-1a255d96-d20b-4726-904b-52c700ee18ce tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:08:31.383464 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG oslo_concurrency.lockutils [None req-1a255d96-d20b-4726-904b-52c700ee18ce tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129953) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:08:31.568345 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [req-94864e77-399e-465f-b185-4fdbc6e0c70e req-87ed40ae-5dea-4eb0-a538-f8df4397515a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08091fd4-fdee-47e2-8f4c-772622ff2837", "name": "network-vif-deleted", "tag": "eab89b32-bc20-4112-a7c7-fa0ff15d11d9"}]} {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 11:08:31.579521 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [req-94864e77-399e-465f-b185-4fdbc6e0c70e req-87ed40ae-5dea-4eb0-a538-f8df4397515a service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:08:31.580076 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [req-94864e77-399e-465f-b185-4fdbc6e0c70e req-87ed40ae-5dea-4eb0-a538-f8df4397515a service nova] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:08:31.590237 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.policy [None req-1a255d96-d20b-4726-904b-52c700ee18ce tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7509ddedcec74149bb850e4adf64b489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb052a6c83084dd9bdbf408ad8870c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129953) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 11:08:31.591713 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.compute.server_external_events [req-94864e77-399e-465f-b185-4fdbc6e0c70e req-87ed40ae-5dea-4eb0-a538-f8df4397515a service nova] Creating event network-vif-deleted:eab89b32-bc20-4112-a7c7-fa0ff15d11d9 for instance 08091fd4-fdee-47e2-8f4c-772622ff2837 on hv-cinder-85031 Aug 02 11:08:31.597107 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [req-94864e77-399e-465f-b185-4fdbc6e0c70e req-87ed40ae-5dea-4eb0-a538-f8df4397515a service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034021 Aug 02 11:08:31.597696 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 566/1140] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Aug 2 11:08:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 11:08:31.598476 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-1a255d96-d20b-4726-904b-52c700ee18ce tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] 10.222.0.115 "GET /compute/v2.1/servers/08091fd4-fdee-47e2-8f4c-772622ff2837" status: 200 len: 1557 microversion: 2.1 time: 0.228516 Aug 02 11:08:31.607182 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 575/1141] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:08:31 2022] GET /compute/v2.1/servers/08091fd4-fdee-47e2-8f4c-772622ff2837 => generated 1557 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 11:08:32.621655 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-95556a88-8a44-4fbb-a4c9-ae2d35e28d8b tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Calling method '>' {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:08:32.622341 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.compute.api [None req-95556a88-8a44-4fbb-a4c9-ae2d35e28d8b tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] [instance: 08091fd4-fdee-47e2-8f4c-772622ff2837] Fetching instance by UUID {{(pid=129952) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 11:08:32.629123 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-95556a88-8a44-4fbb-a4c9-ae2d35e28d8b tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:08:32.630022 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-95556a88-8a44-4fbb-a4c9-ae2d35e28d8b tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:08:32.630300 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-95556a88-8a44-4fbb-a4c9-ae2d35e28d8b tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 11:08:32.630727 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG oslo_concurrency.lockutils [None req-95556a88-8a44-4fbb-a4c9-ae2d35e28d8b tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Lock "c4ec51eb-1726-4f2a-ad0d-901b2f36d6c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 11:08:32.644765 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.wsgi [None req-95556a88-8a44-4fbb-a4c9-ae2d35e28d8b tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] HTTP exception thrown: Instance 08091fd4-fdee-47e2-8f4c-772622ff2837 could not be found. Aug 02 11:08:32.646344 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-95556a88-8a44-4fbb-a4c9-ae2d35e28d8b tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Request method failure captured: Aug 02 11:08:32.646344 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: request: GET /compute/v2.1/servers/08091fd4-fdee-47e2-8f4c-772622ff2837 HTTP/1.1 Aug 02 11:08:32.646344 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Accept: application/json Aug 02 11:08:32.646344 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Accept-Encoding: identity Aug 02 11:08:32.646344 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Connection: close Aug 02 11:08:32.646344 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Content-Length: 0 Aug 02 11:08:32.646344 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Content-Type: application/json Aug 02 11:08:32.646344 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Host: 10.222.0.115 Aug 02 11:08:32.646344 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Openstack-System-Scope: None Aug 02 11:08:32.646344 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: User-Agent: python-urllib3/1.26.10 Aug 02 11:08:32.646344 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Auth-Token: gAAAAABi6QUwpwgdFseFkJH3QUoTnvGDz6UkqUf73miduRaPUHdpJD2yytZBoWq5zHgzcmb8PDH7jw9dboq-hdG6OCKwcky-4yYFnxRlFKWGkgLx69xZGeTizEK8xZck84woHT4dT_rOEyU9p_yq81aOg4BF-jOXRF7JTOarhjMPU81EFjir4nQ Aug 02 11:08:32.646344 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Domain-Id: None Aug 02 11:08:32.646344 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Domain-Name: None Aug 02 11:08:32.646344 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Identity-Status: Confirmed Aug 02 11:08:32.646344 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Is-Admin-Project: True Aug 02 11:08:32.646344 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Project-Domain-Id: default Aug 02 11:08:32.646344 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Project-Domain-Name: Default Aug 02 11:08:32.646344 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Project-Id: bb052a6c83084dd9bdbf408ad8870c16 Aug 02 11:08:32.646344 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Project-Name: tempest-TestMinimumBasicScenario-563232411 Aug 02 11:08:32.646344 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Role: reader,member Aug 02 11:08:32.646344 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Roles: reader,member Aug 02 11:08:32.648085 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/bb052a6c83084dd9bdbf408ad8870c16"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/compute/v2/bb052a6c83084dd9bdbf408ad8870c16"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/volume/v3/bb052a6c83084dd9bdbf408ad8870c16"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.115/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.115:8080", "publicURL": "http://10.222.0.115:8080/v1/AUTH_bb052a6c83084dd9bdbf408ad8870c16"}]}] Aug 02 11:08:32.648085 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Tenant: tempest-TestMinimumBasicScenario-563232411 Aug 02 11:08:32.648085 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Tenant-Id: bb052a6c83084dd9bdbf408ad8870c16 Aug 02 11:08:32.648085 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-Tenant-Name: tempest-TestMinimumBasicScenario-563232411 Aug 02 11:08:32.648085 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User: tempest-TestMinimumBasicScenario-563232411-project Aug 02 11:08:32.648085 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User-Domain-Id: default Aug 02 11:08:32.648085 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User-Domain-Name: Default Aug 02 11:08:32.648085 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User-Id: 7509ddedcec74149bb850e4adf64b489 Aug 02 11:08:32.648085 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: X-User-Name: tempest-TestMinimumBasicScenario-563232411-project Aug 02 11:08:32.648085 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: method: > Aug 02 11:08:32.648085 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: exception: Instance 08091fd4-fdee-47e2-8f4c-772622ff2837 could not be found. Aug 02 11:08:32.648085 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: action_args: {'id': '08091fd4-fdee-47e2-8f4c-772622ff2837'} Aug 02 11:08:32.649092 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: {{(pid=129952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 11:08:32.649092 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:08:32.649092 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 11:08:32.649092 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 11:08:32.649092 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 11:08:32.649092 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 11:08:32.649092 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 11:08:32.649092 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 11:08:32.649092 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 11:08:32.649092 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 11:08:32.649092 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08091fd4-fdee-47e2-8f4c-772622ff2837 could not be found. Aug 02 11:08:32.649092 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 11:08:32.649092 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 11:08:32.649092 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 11:08:32.649092 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:08:32.649092 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 11:08:32.649092 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 11:08:32.649092 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 11:08:32.649092 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 11:08:32.649092 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 11:08:32.650862 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 11:08:32.650862 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 11:08:32.650862 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 11:08:32.650862 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 11:08:32.650862 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 11:08:32.650862 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 11:08:32.650862 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 11:08:32.650862 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08091fd4-fdee-47e2-8f4c-772622ff2837 could not be found. Aug 02 11:08:32.650862 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 11:08:32.650862 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 11:08:32.650862 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 11:08:32.650862 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 11:08:32.650862 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 11:08:32.650862 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 11:08:32.650862 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 11:08:32.650862 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 11:08:32.650862 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08091fd4-fdee-47e2-8f4c-772622ff2837 could not be found. Aug 02 11:08:32.650862 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: ERROR nova.api.openstack.wsgi Aug 02 11:08:32.652706 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: DEBUG nova.api.openstack.wsgi [None req-95556a88-8a44-4fbb-a4c9-ae2d35e28d8b tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Returning 404 to user: Instance 08091fd4-fdee-47e2-8f4c-772622ff2837 could not be found. {{(pid=129952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 11:08:32.652706 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO nova.api.openstack.requestlog [None req-95556a88-8a44-4fbb-a4c9-ae2d35e28d8b tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] 10.222.0.115 "GET /compute/v2.1/servers/08091fd4-fdee-47e2-8f4c-772622ff2837" status: 404 len: 111 microversion: 2.1 time: 0.030888 Aug 02 11:08:32.652706 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: [pid: 129952|app: 0|req: 567/1142] 10.222.0.115 () {58 vars in 1241 bytes} [Tue Aug 2 11:08:32 2022] GET /compute/v2.1/servers/08091fd4-fdee-47e2-8f4c-772622ff2837 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 11:08:32.656732 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: DEBUG nova.api.openstack.wsgi [None req-51cc682f-a8c7-4f33-b072-0660a7583212 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] Calling method '.version_select at 0x7f7c4e56ac10>' {{(pid=129953) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 11:08:32.727374 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO nova.api.openstack.requestlog [None req-51cc682f-a8c7-4f33-b072-0660a7583212 tempest-TestMinimumBasicScenario-563232411 tempest-TestMinimumBasicScenario-563232411-project] 10.222.0.115 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-15166502" status: 202 len: 0 microversion: 2.1 time: 0.074510 Aug 02 11:08:32.727956 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: [pid: 129953|app: 0|req: 576/1143] 10.222.0.115 () {58 vars in 1271 bytes} [Tue Aug 2 11:08:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-15166502 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 11:10:40.164413 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 11:10:40.165058 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Tue Aug 2 11:10:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 11:11:50.133370 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 11:11:50.134006 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Tue Aug 2 11:11:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 11:11:51.345190 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 11:11:51.345704 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Tue Aug 2 11:11:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 11:11:52.441289 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 11:11:52.441920 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Tue Aug 2 11:11:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 11:12:03.330637 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 11:12:03.331143 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Tue Aug 2 11:12:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 11:13:43.915187 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 11:13:43.915917 dv-cinder-850318-6-iscsi devstack@n-api.service[129953]: Tue Aug 2 11:13:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 11:14:00.172378 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 11:14:00.172982 dv-cinder-850318-6-iscsi devstack@n-api.service[129952]: Tue Aug 2 11:14:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!